[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:15 dist-test-slave-mjjr krb5kdc[30381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:15 dist-test-slave-mjjr krb5kdc[30381](info): set up 2 sockets
Aug 08 14:40:15 dist-test-slave-mjjr krb5kdc[30381](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 14:40:16.813632 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:16 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:16.934540 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41837
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:17.017436 30400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:17.017649 30400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:17.017684 30400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:17.018744 30400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:17.018810 30400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:17.018832 30400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:17.018851 30400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:17.018878 30400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:17.020351 30400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:17.020743 30400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:17.021027 30400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:17.027563 30411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:17.027598 30400 server_base.cc:1034] running on GCE node
W20260808 14:40:17.028301 30410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:17.028756 30415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:17.029052 30400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:17.029444 30400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:17.030611 30400 hybrid_clock.cc:648] HybridClock initialized: now 1786200017030615 us; error 61 us; skew 500 ppm
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:17.033221 30400 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:17.033812 30400 webserver.cc:460] Webserver started at http://127.29.168.254:42727/ using document root <none> and password file <none>
I20260808 14:40:17.034121 30400 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:17.034193 30400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:17.034387 30400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:17.035524 30400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "4efc6e2d888dd62192e50eb4c0a965c8"
server_key_iv: "b382a7562b02a444af41b00a242e6fc8"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.035949 30400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "4efc6e2d888dd62192e50eb4c0a965c8"
server_key_iv: "b382a7562b02a444af41b00a242e6fc8"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.037621 30400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:17.038509 30425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.038753 30400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:17.038854 30400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "4efc6e2d888dd62192e50eb4c0a965c8"
server_key_iv: "b382a7562b02a444af41b00a242e6fc8"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.038931 30400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:17.054162 30400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:17.056787 30400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:17.057008 30400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:17.066164 30400 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41837
I20260808 14:40:17.066356 30488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41837 every 8 connection(s)
I20260808 14:40:17.066855 30400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:17.068392 30492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:17.069384 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30400
I20260808 14:40:17.069500 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:17.070200 30371 external_mini_cluster.cc:1428] Setting key 64d64407a2a7fc0bb8cf249eea834fe2
I20260808 14:40:17.071907 30492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620: Bootstrap starting.
I20260808 14:40:17.073338 30492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:17.074195 30492 log.cc:824] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:17.075348 30492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620: No bootstrap required, opened a new log
I20260808 14:40:17.079586 30492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41837 } }
I20260808 14:40:17.079809 30492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:17.079898 30492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43d3a4d5a0b74eb48ed4c2b861cf1620, State: Initialized, Role: FOLLOWER
I20260808 14:40:17.080065 30492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41837 } }
I20260808 14:40:17.080178 30492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:17.080221 30492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:17.080291 30492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:17.081228 30492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41837 } }
I20260808 14:40:17.081444 30492 leader_election.cc:302] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43d3a4d5a0b74eb48ed4c2b861cf1620; no voters:
I20260808 14:40:17.081704 30492 leader_election.cc:288] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:17.081841 30499 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:17.082178 30499 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [term 1 LEADER]: Becoming Leader. State: Replica: 43d3a4d5a0b74eb48ed4c2b861cf1620, State: Running, Role: LEADER
I20260808 14:40:17.082329 30492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:17.082350 30499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41837 } }
I20260808 14:40:17.083141 30501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43d3a4d5a0b74eb48ed4c2b861cf1620. Latest consensus state: current_term: 1 leader_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41837 } } }
I20260808 14:40:17.083309 30501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:17.083348 30500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d3a4d5a0b74eb48ed4c2b861cf1620" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41837 } } }
I20260808 14:40:17.083578 30500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:17.084436 30506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:17.086064 30506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:17.089949 30506 catalog_manager.cc:1347] Generated new cluster ID: b6cff71b0c06401e9c8b34a0892e5962
I20260808 14:40:17.090036 30506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:17.092332 30494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.071407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47468 (local address 127.29.168.254:41837)
0808 14:40:17.071859 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:17.071870 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:17.072043 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:40:17.075458 (+ 3415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:17.075467 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:17.075621 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:17.075814 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:17.077446 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.079565 (+ 2119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.080875 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.081646 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.081774 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.087994 (+ 6220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:17.087998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:17.087999 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:17.088010 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:17.090436 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.090843 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.090848 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.090848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.090951 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.091214 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.091215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.091215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.091443 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:17.091581 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:17.091905 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 14:40:17.092099 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":107,"threads_started":1}
I20260808 14:40:17.112568 30506 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:17.113391 30506 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:17.118181 30506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43d3a4d5a0b74eb48ed4c2b861cf1620: Generated new TSK 0
I20260808 14:40:17.118383 30506 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:17.158365 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41837
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:17.294230 30526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:17.294412 30526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:17.294435 30526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:17.295557 30526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:17.295598 30526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:17.295622 30526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:17.297133 30526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41837
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:17.297430 30526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:17.297708 30526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:17.304939 30536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:17.305069 30537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:17.305315 30539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:17.305512 30526 server_base.cc:1034] running on GCE node
I20260808 14:40:17.305704 30526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:17.305922 30526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:17.307078 30526 hybrid_clock.cc:648] HybridClock initialized: now 1786200017307066 us; error 30 us; skew 500 ppm
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:17.310405 30526 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:17.310847 30526 webserver.cc:460] Webserver started at http://127.29.168.193:33047/ using document root <none> and password file <none>
I20260808 14:40:17.311115 30526 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:17.311182 30526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:17.311316 30526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:17.312367 30526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "50776bdd93074ce0ae6ae8e98caeb4c8"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "cee34052db7f603871f0e21e1ba3555d"
server_key_iv: "6ea699e6af6fdc97c00caf3ee2051459"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.312692 30526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "50776bdd93074ce0ae6ae8e98caeb4c8"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "cee34052db7f603871f0e21e1ba3555d"
server_key_iv: "6ea699e6af6fdc97c00caf3ee2051459"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.314033 30526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:17.314862 30547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.315023 30526 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:17.315114 30526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "50776bdd93074ce0ae6ae8e98caeb4c8"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "cee34052db7f603871f0e21e1ba3555d"
server_key_iv: "6ea699e6af6fdc97c00caf3ee2051459"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.315189 30526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:17.324846 30526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:17.326628 30526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:17.326834 30526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:17.327088 30526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:17.327483 30526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:17.327587 30526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.327666 30526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:17.327699 30526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.339352 30526 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:43659
I20260808 14:40:17.339452 30710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:43659 every 8 connection(s)
I20260808 14:40:17.339777 30526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:17.344707 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30526
I20260808 14:40:17.344818 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:17.344962 30371 external_mini_cluster.cc:1428] Setting key e4c96a78f1554a125bdac83431897f77
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:17.349902 30494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.340664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:48787 (local address 127.29.168.254:41837)
0808 14:40:17.340725 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:17.340727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:17.341106 (+ 379us) server_negotiation.cc:407] Connection header received
0808 14:40:17.341926 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:17.341927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:17.341940 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:17.342006 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:17.343111 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.343573 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.344654 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.344926 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.345013 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.347303 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:17.347305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:17.347305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:17.347313 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:17.348651 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.349030 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.349032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.349032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.349088 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.349326 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.349327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.349327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.349430 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:17.349494 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:17.349739 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:40:17.349818 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:40:17.350088 30716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.340637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41837 (local address 127.29.168.193:48787)
0808 14:40:17.340988 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:17.341023 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:17.341818 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:17.342086 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:17.342089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:17.342747 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:17.343017 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:17.343021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.343681 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.343686 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:17.344542 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:17.344544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.345024 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.345025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:17.345232 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.345827 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:17.345834 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:17.347202 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:17.348746 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:17.348753 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:17.348755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:17.348960 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:17.349151 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:17.349152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:17.349152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:17.349255 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:17.349499 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:17.349506 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:17.349625 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 14:40:17.349719 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:40:17.349863 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":214,"threads_started":1}
I20260808 14:40:17.350713 30711 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41837
I20260808 14:40:17.350829 30711 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:17.351015 30711 heartbeater.cc:511] Master 127.29.168.254:41837 requested a full tablet report, sending...
I20260808 14:40:17.352056 30449 ts_manager.cc:194] Registered new tserver with Master: 50776bdd93074ce0ae6ae8e98caeb4c8 (127.29.168.193:43659)
I20260808 14:40:17.353188 30449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:48787
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:17.370471 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41837
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:17.451347 30719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:17.451538 30719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:17.451563 30719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:17.452636 30719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:17.452677 30719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:17.452703 30719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:17.454032 30719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41837
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:17.454217 30719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:17.454377 30719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:17.459121 30727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:17.459127 30726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:17.459218 30732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:17.459313 30719 server_base.cc:1034] running on GCE node
I20260808 14:40:17.459492 30719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:17.459775 30719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:17.460952 30719 hybrid_clock.cc:648] HybridClock initialized: now 1786200017460935 us; error 38 us; skew 500 ppm
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:17.463420 30719 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:17.463917 30719 webserver.cc:460] Webserver started at http://127.29.168.194:34271/ using document root <none> and password file <none>
I20260808 14:40:17.464134 30719 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:17.464200 30719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:17.464336 30719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:17.465354 30719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "5474363ad37141d3bfacb85a85cc4eeb"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "00bf89c7be52342409120f58530e5bf8"
server_key_iv: "a04d94615541a83623036a118a2780b8"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.465741 30719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "5474363ad37141d3bfacb85a85cc4eeb"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "00bf89c7be52342409120f58530e5bf8"
server_key_iv: "a04d94615541a83623036a118a2780b8"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.467211 30719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:17.468067 30741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.468254 30719 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.468353 30719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "5474363ad37141d3bfacb85a85cc4eeb"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "00bf89c7be52342409120f58530e5bf8"
server_key_iv: "a04d94615541a83623036a118a2780b8"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.468429 30719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:17.477099 30719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:17.478853 30719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:17.479018 30719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:17.479259 30719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:17.479566 30719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:17.479620 30719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.479681 30719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:17.479707 30719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.486342 30719 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:39625
I20260808 14:40:17.486402 30899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:39625 every 8 connection(s)
I20260808 14:40:17.486697 30719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:17.495093 30494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.487375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:52985 (local address 127.29.168.254:41837)
0808 14:40:17.487430 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:17.487432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:17.487607 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:40:17.488074 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:17.488075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:17.488084 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:17.488135 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:17.488961 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.489451 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.490358 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.490523 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.490569 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.492650 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:17.492652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:17.492652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:17.492659 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:17.494038 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.494375 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.494375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.494376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.494423 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.494651 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.494652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.494652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.494743 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:17.494789 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:17.494973 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 14:40:17.495033 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:40:17.495255 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.487324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41837 (local address 127.29.168.194:52985)
0808 14:40:17.487486 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:17.487523 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:17.487997 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:17.488203 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:17.488205 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:17.488717 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:17.488889 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:17.488893 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.489542 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.489543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:17.490288 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:17.490290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.490589 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.490589 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:17.490674 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.491080 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:17.491088 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:17.492549 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:17.494103 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:17.494109 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:17.494110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:17.494308 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:17.494496 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:17.494497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:17.494497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:17.494587 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:17.494782 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:17.494784 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:17.494875 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 14:40:17.494944 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:40:17.495048 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
I20260808 14:40:17.495352 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30719
I20260808 14:40:17.495443 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:17.495613 30371 external_mini_cluster.cc:1428] Setting key 2a95a3ed94781e0e23382572792471d2
I20260808 14:40:17.495993 30901 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41837
I20260808 14:40:17.496084 30901 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:17.496263 30901 heartbeater.cc:511] Master 127.29.168.254:41837 requested a full tablet report, sending...
I20260808 14:40:17.496646 30449 ts_manager.cc:194] Registered new tserver with Master: 5474363ad37141d3bfacb85a85cc4eeb (127.29.168.194:39625)
I20260808 14:40:17.497023 30449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:52985
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:17.519515 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41837
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:17.609020 30908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:17.609227 30908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:17.609266 30908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:17.610353 30908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:17.610414 30908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:17.610457 30908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:17.611989 30908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41837
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:17.612263 30908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:17.612491 30908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:17.617340 30915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:17.617326 30917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:17.617395 30908 server_base.cc:1034] running on GCE node
W20260808 14:40:17.617326 30914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:17.617646 30908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:17.617856 30908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:17.618985 30908 hybrid_clock.cc:648] HybridClock initialized: now 1786200017618973 us; error 28 us; skew 500 ppm
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:17.621367 30908 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:17.621801 30908 webserver.cc:460] Webserver started at http://127.29.168.195:44925/ using document root <none> and password file <none>
I20260808 14:40:17.622038 30908 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:17.622105 30908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:17.622267 30908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:17.623225 30908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "fc4cae103fbc45adb1dc00ad44bd44ca"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "ad8fc547c3b71e18b3f930ae00c678d7"
server_key_iv: "01820e02919b5ebb0c25dc8ac710bc8d"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.623585 30908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "fc4cae103fbc45adb1dc00ad44bd44ca"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "ad8fc547c3b71e18b3f930ae00c678d7"
server_key_iv: "01820e02919b5ebb0c25dc8ac710bc8d"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.624897 30908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:17.625582 30928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.625741 30908 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:17.625837 30908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "fc4cae103fbc45adb1dc00ad44bd44ca"
format_stamp: "Formatted at 2026-08-08 14:40:17 on dist-test-slave-mjjr"
server_key: "ad8fc547c3b71e18b3f930ae00c678d7"
server_key_iv: "01820e02919b5ebb0c25dc8ac710bc8d"
server_key_version: "encryptionkey@0"
I20260808 14:40:17.625916 30908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:17.637146 30908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:17.639045 30908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:17.639206 30908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:17.639565 30908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:17.640026 30908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:17.640084 30908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.640129 30908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:17.640156 30908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:17.646870 30908 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:33725
I20260808 14:40:17.646976 31096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:33725 every 8 connection(s)
I20260808 14:40:17.647218 30908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:17.653734 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30908
I20260808 14:40:17.653820 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:17.653985 30371 external_mini_cluster.cc:1428] Setting key 87a5ef6de99d343299d31a842aec52fd
I20260808 14:40:17.656544 30494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.647880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:53469 (local address 127.29.168.254:41837)
0808 14:40:17.647927 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:17.647929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:17.648128 (+ 199us) server_negotiation.cc:407] Connection header received
0808 14:40:17.648789 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:17.648791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:17.648804 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:17.648856 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:17.649796 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.650260 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.651264 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.651476 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.651553 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.653676 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:17.653678 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:17.653678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:17.653687 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:17.655339 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.655735 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.655735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.655736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.655803 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.656040 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.656041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.656041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.656132 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:17.656177 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:17.656420 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 14:40:17.656483 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:40:17.656770 31100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.647847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41837 (local address 127.29.168.195:53469)
0808 14:40:17.648011 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:17.648042 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:17.648662 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:17.648931 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:17.648934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:17.649504 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:17.649670 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:17.649674 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.650361 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.650362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:17.651166 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:17.651169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.651571 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.651572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:17.651765 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.652211 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:17.652219 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:17.653587 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:17.655403 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:17.655408 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:17.655410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:17.655627 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:17.655868 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:17.655869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:17.655869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:17.655985 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:17.656168 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:17.656170 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:17.656261 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 14:40:17.656379 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 14:40:17.656514 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260808 14:40:17.657236 31097 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41837
I20260808 14:40:17.657335 31097 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:17.657502 31097 heartbeater.cc:511] Master 127.29.168.254:41837 requested a full tablet report, sending...
I20260808 14:40:17.657868 30449 ts_manager.cc:194] Registered new tserver with Master: fc4cae103fbc45adb1dc00ad44bd44ca (127.29.168.195:33725)
I20260808 14:40:17.658190 30449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:53469
I20260808 14:40:17.665997 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:17.690052 31106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.682526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35242 (local address 127.29.168.193:43659)
0808 14:40:17.682692 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:17.682697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:17.682720 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:40:17.682759 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:17.682761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:17.682782 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:17.682874 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:17.683558 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.684323 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.685125 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.685445 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.685543 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.687774 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:17.687781 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:17.687782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:17.687788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:17.689110 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.689423 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.689425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.689425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.689477 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.689644 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.689645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.689645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.689756 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:17.689888 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:17.689924 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:40:17.689981 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":102,"threads_started":1}
W20260808 14:40:17.690567 30592 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35242
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[30381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:17.712437 31106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:17.705688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35252 (local address 127.29.168.193:43659)
0808 14:40:17.705745 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:17.705748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:17.705782 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:40:17.705866 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:17.705867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:17.705881 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:17.705954 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:17.706559 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.707100 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.707940 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:17.708152 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:17.708262 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:17.710318 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:17.710319 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:17.710320 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:17.710326 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:17.711528 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.711869 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.711869 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.711870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.711922 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:17.712079 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:17.712080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:17.712080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:17.712173 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:17.712279 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:17.712326 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 14:40:17.712383 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:40:17.712947 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30526
I20260808 14:40:17.726576 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30719
I20260808 14:40:17.747238 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30908
I20260808 14:40:17.754652 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30400
2026-08-08T14:40:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2128 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[31114](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[31114](info): set up 2 sockets
Aug 08 14:40:17 dist-test-slave-mjjr krb5kdc[31114](info): commencing operation
krb5kdc: starting...
W20260808 14:40:18.944936 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:19.056829 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37219
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:19.137562 31132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:19.137809 31132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:19.137844 31132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:19.138972 31132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:19.139034 31132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:19.139060 31132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:19.139081 31132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:19.139107 31132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:19.140585 31132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:19.140851 31132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:19.141065 31132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:19.145785 31143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.145884 31139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.145782 31138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:19.146239 31132 server_base.cc:1034] running on GCE node
I20260808 14:40:19.146538 31132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:19.146839 31132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:19.148015 31132 hybrid_clock.cc:648] HybridClock initialized: now 1786200019147998 us; error 46 us; skew 500 ppm
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:19.150399 31132 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:19.150818 31132 webserver.cc:460] Webserver started at http://127.29.168.254:46573/ using document root <none> and password file <none>
I20260808 14:40:19.151059 31132 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:19.151181 31132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:19.151320 31132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:19.152374 31132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "15a2414ff1584c17bff5573fa9b187bb"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "cb4911a04c3d4d0280920cba737ff5a6"
server_key_iv: "a6e40fde645083106e5dca02648b51ad"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.152717 31132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "15a2414ff1584c17bff5573fa9b187bb"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "cb4911a04c3d4d0280920cba737ff5a6"
server_key_iv: "a6e40fde645083106e5dca02648b51ad"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.154011 31132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:19.154757 31150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.154934 31132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:19.155018 31132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "15a2414ff1584c17bff5573fa9b187bb"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "cb4911a04c3d4d0280920cba737ff5a6"
server_key_iv: "a6e40fde645083106e5dca02648b51ad"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.155099 31132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:19.170897 31132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:19.172705 31132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:19.172860 31132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:19.176972 31132 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:37219
I20260808 14:40:19.177009 31227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:37219 every 8 connection(s)
I20260808 14:40:19.177332 31132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:19.178117 31228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:19.180392 31228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb: Bootstrap starting.
I20260808 14:40:19.180927 31228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:19.181239 31228 log.cc:824] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:19.181631 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31132
I20260808 14:40:19.181736 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:19.181910 30371 external_mini_cluster.cc:1428] Setting key e1633b8a66176728aab826905955df8c
I20260808 14:40:19.182035 31228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb: No bootstrap required, opened a new log
I20260808 14:40:19.183857 31228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a2414ff1584c17bff5573fa9b187bb" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37219 } }
I20260808 14:40:19.184029 31228 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:19.184067 31228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a2414ff1584c17bff5573fa9b187bb, State: Initialized, Role: FOLLOWER
I20260808 14:40:19.184226 31228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a2414ff1584c17bff5573fa9b187bb" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37219 } }
I20260808 14:40:19.184341 31228 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:19.184383 31228 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:19.184434 31228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:19.185062 31228 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a2414ff1584c17bff5573fa9b187bb" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37219 } }
I20260808 14:40:19.185143 31228 leader_election.cc:302] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15a2414ff1584c17bff5573fa9b187bb; no voters:
I20260808 14:40:19.185360 31228 leader_election.cc:288] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:19.185385 31235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:19.185503 31235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [term 1 LEADER]: Becoming Leader. State: Replica: 15a2414ff1584c17bff5573fa9b187bb, State: Running, Role: LEADER
I20260808 14:40:19.185585 31235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a2414ff1584c17bff5573fa9b187bb" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37219 } }
I20260808 14:40:19.185624 31228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:19.185880 31235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15a2414ff1584c17bff5573fa9b187bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a2414ff1584c17bff5573fa9b187bb" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37219 } } }
I20260808 14:40:19.185949 31235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:19.186064 31235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15a2414ff1584c17bff5573fa9b187bb. Latest consensus state: current_term: 1 leader_uuid: "15a2414ff1584c17bff5573fa9b187bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a2414ff1584c17bff5573fa9b187bb" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37219 } } }
I20260808 14:40:19.186204 31235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:19.186378 31240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:19.186949 31240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:19.188572 31240 catalog_manager.cc:1347] Generated new cluster ID: de61c137f4254d019499a61203f8f676
I20260808 14:40:19.188622 31240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:19.194183 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.182436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39402 (local address 127.29.168.254:37219)
0808 14:40:19.182581 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.182589 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.182622 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:40:19.183839 (+ 1217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.183845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.183901 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.184019 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.184810 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.186274 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.187378 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.187942 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.188079 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.190615 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.190619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.190619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.190631 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.192623 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.193005 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.193008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.193008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.193152 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.193353 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.193354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.193354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.193642 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.193815 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.193875 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.193998 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260808 14:40:19.210466 31240 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:19.210927 31240 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:19.215252 31240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15a2414ff1584c17bff5573fa9b187bb: Generated new TSK 0
I20260808 14:40:19.215428 31240 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:19.244208 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37219
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:19.324436 31266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:19.324609 31266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:19.324630 31266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:19.325639 31266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:19.325668 31266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:19.325693 31266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:19.327109 31266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37219
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:19.327282 31266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:19.327453 31266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:19.332319 31274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.332356 31272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.332319 31271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:19.332562 31266 server_base.cc:1034] running on GCE node
I20260808 14:40:19.332789 31266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:19.333060 31266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:19.334239 31266 hybrid_clock.cc:648] HybridClock initialized: now 1786200019334224 us; error 24 us; skew 500 ppm
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:19.336778 31266 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:19.337178 31266 webserver.cc:460] Webserver started at http://127.29.168.193:44159/ using document root <none> and password file <none>
I20260808 14:40:19.337415 31266 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:19.337502 31266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:19.337646 31266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:19.338632 31266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "bec2c8f2e72344eda2c88d4135eb56b8"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "725a52d3ac4d6aab3b1c060dba7bd593"
server_key_iv: "57382a8772bb8b6c33665824349731ac"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.339003 31266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "bec2c8f2e72344eda2c88d4135eb56b8"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "725a52d3ac4d6aab3b1c060dba7bd593"
server_key_iv: "57382a8772bb8b6c33665824349731ac"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.340389 31266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:19.341063 31286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.341250 31266 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.341351 31266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "bec2c8f2e72344eda2c88d4135eb56b8"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "725a52d3ac4d6aab3b1c060dba7bd593"
server_key_iv: "57382a8772bb8b6c33665824349731ac"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.341423 31266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:19.357970 31266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:19.359881 31266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:19.360034 31266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:19.360244 31266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:19.360523 31266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:19.360574 31266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.360605 31266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:19.360630 31266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.366436 31266 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:45523
I20260808 14:40:19.366546 31445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:45523 every 8 connection(s)
I20260808 14:40:19.366828 31266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:19.368633 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31266
I20260808 14:40:19.368708 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:19.368868 30371 external_mini_cluster.cc:1428] Setting key 587078f98667408111362c279051ffb9
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:19.376653 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.367590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:51753 (local address 127.29.168.254:37219)
0808 14:40:19.367698 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.367701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.367870 (+ 169us) server_negotiation.cc:407] Connection header received
0808 14:40:19.368944 (+ 1074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.368946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.368957 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.369003 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.369732 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.370219 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.371239 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.371455 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.371541 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.373695 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.373696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.373697 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.373704 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.375135 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.375591 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.375593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.375593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.375693 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.375949 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.375950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.375951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.376074 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.376151 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.376452 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.376550 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:40:19.376864 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.367560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37219 (local address 127.29.168.193:51753)
0808 14:40:19.367740 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.367780 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.368809 (+ 1029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.369079 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.369083 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.369420 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:19.369641 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.369646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.370336 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.370338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.371142 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.371144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.371556 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.371557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.371709 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.372211 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:19.372219 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:19.373591 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:19.375255 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:19.375263 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:19.375265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:19.375509 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:19.375767 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:19.375768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:19.375768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:19.375878 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:19.376143 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:19.376150 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:19.376284 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.376409 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.376579 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":116,"threads_started":1}
I20260808 14:40:19.377308 31446 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37219
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
I20260808 14:40:19.377403 31446 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:19.377581 31446 heartbeater.cc:511] Master 127.29.168.254:37219 requested a full tablet report, sending...
I20260808 14:40:19.378072 31178 ts_manager.cc:194] Registered new tserver with Master: bec2c8f2e72344eda2c88d4135eb56b8 (127.29.168.193:45523)
I20260808 14:40:19.378638 31178 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:51753
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:19.395188 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37219
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:19.475411 31451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:19.475601 31451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:19.475622 31451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:19.476722 31451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:19.476763 31451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:19.476811 31451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:19.478277 31451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37219
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:19.478507 31451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:19.478711 31451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:19.483655 31460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.483619 31464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.483608 31461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:19.483857 31451 server_base.cc:1034] running on GCE node
I20260808 14:40:19.484115 31451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:19.484359 31451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:19.485517 31451 hybrid_clock.cc:648] HybridClock initialized: now 1786200019485509 us; error 33 us; skew 500 ppm
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:19.492506 31451 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:19.492918 31451 webserver.cc:460] Webserver started at http://127.29.168.194:40193/ using document root <none> and password file <none>
I20260808 14:40:19.493088 31451 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:19.493124 31451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:19.493202 31451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:19.494112 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "2c38dd02fb16493996408a137cc5b5e2"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "1fc34894e314084c9a46cb3dfc775fc2"
server_key_iv: "60ff480601815de0002b9e41a2551a39"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.494383 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "2c38dd02fb16493996408a137cc5b5e2"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "1fc34894e314084c9a46cb3dfc775fc2"
server_key_iv: "60ff480601815de0002b9e41a2551a39"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.495539 31451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:19.496369 31476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.496546 31451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:19.496629 31451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "2c38dd02fb16493996408a137cc5b5e2"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "1fc34894e314084c9a46cb3dfc775fc2"
server_key_iv: "60ff480601815de0002b9e41a2551a39"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.496680 31451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:19.521999 31451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:19.523774 31451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:19.523875 31451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:19.524045 31451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:19.524274 31451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:19.524302 31451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.524322 31451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:19.524333 31451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.530062 31451 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:41919
I20260808 14:40:19.530138 31642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:41919 every 8 connection(s)
I20260808 14:40:19.530460 31451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:19.539551 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.531238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:55745 (local address 127.29.168.254:37219)
0808 14:40:19.531295 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.531297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.531481 (+ 184us) server_negotiation.cc:407] Connection header received
0808 14:40:19.532391 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.532393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.532402 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.532458 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.533024 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.533496 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.535030 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.535234 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.535295 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.537294 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.537295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.537296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.537302 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.538467 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.538806 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.538807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.538807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.538854 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.539053 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.539054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.539054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.539155 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.539199 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.539436 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.539494 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:19.539745 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.531194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37219 (local address 127.29.168.194:55745)
0808 14:40:19.531364 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.531404 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.532292 (+ 888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.532550 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.532552 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.532783 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:19.532959 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.532962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.533597 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.533599 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.534956 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.534958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.535310 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.535311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.535403 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.535930 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:19.535937 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:19.537213 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:19.538534 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:19.538540 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:19.538541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:19.538744 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:19.538910 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:19.538910 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:19.538910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:19.539002 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:19.539203 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:19.539207 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:19.539342 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.539415 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.539514 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260808 14:40:19.540073 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31451
I20260808 14:40:19.540187 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:19.540191 31644 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37219
I20260808 14:40:19.540270 31644 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:19.540390 30371 external_mini_cluster.cc:1428] Setting key 35e962bec93e2266b06ce117d65d75e8
I20260808 14:40:19.540447 31644 heartbeater.cc:511] Master 127.29.168.254:37219 requested a full tablet report, sending...
I20260808 14:40:19.540793 31177 ts_manager.cc:194] Registered new tserver with Master: 2c38dd02fb16493996408a137cc5b5e2 (127.29.168.194:41919)
I20260808 14:40:19.541210 31177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:55745
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:19.564216 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37219
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:19.642907 31653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:19.643110 31653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:19.643136 31653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:19.644271 31653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:19.644315 31653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:19.644340 31653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:19.645766 31653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37219
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:19.645994 31653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:19.646185 31653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:19.650906 31661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.650918 31663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:19.650897 31665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:19.651255 31653 server_base.cc:1034] running on GCE node
I20260808 14:40:19.651489 31653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:19.651785 31653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:19.652946 31653 hybrid_clock.cc:648] HybridClock initialized: now 1786200019652934 us; error 25 us; skew 500 ppm
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:19.655411 31653 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:19.655898 31653 webserver.cc:460] Webserver started at http://127.29.168.195:45677/ using document root <none> and password file <none>
I20260808 14:40:19.656159 31653 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:19.656234 31653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:19.656370 31653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:19.657368 31653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "80c6af4bef7b4243ae0b2a5860e959cf"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "53fb2a64f5286c9338f6dbee2ede1af6"
server_key_iv: "ec6d45d1266b189ff3825ee2f5c479aa"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.657783 31653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "80c6af4bef7b4243ae0b2a5860e959cf"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "53fb2a64f5286c9338f6dbee2ede1af6"
server_key_iv: "ec6d45d1266b189ff3825ee2f5c479aa"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.659111 31653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:40:19.659880 31674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.660053 31653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:19.660156 31653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "80c6af4bef7b4243ae0b2a5860e959cf"
format_stamp: "Formatted at 2026-08-08 14:40:19 on dist-test-slave-mjjr"
server_key: "53fb2a64f5286c9338f6dbee2ede1af6"
server_key_iv: "ec6d45d1266b189ff3825ee2f5c479aa"
server_key_version: "encryptionkey@0"
I20260808 14:40:19.660244 31653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:19.674996 31653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:19.677320 31653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:19.677424 31653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:19.677572 31653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:19.677855 31653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:19.677891 31653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.677910 31653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:19.677956 31653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:19.683928 31653 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:46775
I20260808 14:40:19.683993 31833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:46775 every 8 connection(s)
I20260808 14:40:19.684288 31653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:19.688459 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31653
I20260808 14:40:19.688571 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:19.688724 30371 external_mini_cluster.cc:1428] Setting key 79d1004edf0246b912dcf1c404f430dc
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:19.693840 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.684963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:37399 (local address 127.29.168.254:37219)
0808 14:40:19.685008 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.685010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.685223 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:40:19.686163 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.686165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.686178 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.686224 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.687128 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.687739 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.688812 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.689079 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.689175 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.691234 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.691236 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.691237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.691252 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.692459 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.692895 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.692896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.692897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.692950 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.693198 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.693200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.693200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.693312 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.693383 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.693673 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.693751 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:19.694036 31837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.684939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37219 (local address 127.29.168.195:37399)
0808 14:40:19.685088 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.685127 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.686057 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.686296 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.686301 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.686784 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:19.687011 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.687017 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.687851 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.687852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.688702 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.688704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.689203 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.689204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.689335 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.689838 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:19.689846 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:19.691116 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:19.692572 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:19.692579 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:19.692581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:19.692814 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:19.693018 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:19.693019 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:19.693020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:19.693121 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:19.693376 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:19.693382 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:19.693525 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.693645 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.693797 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260808 14:40:19.694525 31835 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37219
I20260808 14:40:19.694614 31835 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:19.694737 31835 heartbeater.cc:511] Master 127.29.168.254:37219 requested a full tablet report, sending...
I20260808 14:40:19.695072 31177 ts_manager.cc:194] Registered new tserver with Master: 80c6af4bef7b4243ae0b2a5860e959cf (127.29.168.195:46775)
I20260808 14:40:19.695395 31177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:37399
I20260808 14:40:19.700491 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:40:19.707227 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.702244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39404 (local address 127.29.168.254:37219)
0808 14:40:19.702296 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.702297 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.702424 (+ 127us) server_negotiation.cc:407] Connection header received
0808 14:40:19.702457 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.702458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.702465 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.702505 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.702935 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.703372 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.704006 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.704160 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.704206 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.705241 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.705247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.705248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.705252 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.706343 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.706648 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.706649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.706649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.706695 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.706815 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.706816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.706816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.706930 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.707001 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.707092 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.707145 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:40:19.710115 31177 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39404:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:19.711974 31177 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:19.719137 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.715017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:45523 (local address 127.0.0.1:53336)
0808 14:40:19.715343 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.715353 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.715467 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.716153 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.716154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.716157 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:19.716203 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.716204 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.717299 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.717300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.718178 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.718181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.718818 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.718819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.718905 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.718917 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.719014 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.719067 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":4,"thread_start_us":60,"threads_started":1}
I20260808 14:40:19.719147 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.715163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53336 (local address 127.29.168.193:45523)
0808 14:40:19.715413 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.715417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.715457 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:40:19.715884 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.715888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.715953 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.716042 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:19.716291 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.717201 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.718255 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.718734 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.718819 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.718872 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.719033 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.719072 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":110,"threads_started":1}
I20260808 14:40:19.719389 31852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.714809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:46775 (local address 127.0.0.1:42152)
0808 14:40:19.715136 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.715173 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.715235 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.715531 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.715534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.715537 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:19.715606 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.715608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.716945 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.716946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.718205 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.718207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.719164 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.719165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.719232 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.719235 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.719269 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.719313 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":77,"thread_start_us":63,"threads_started":1}
I20260808 14:40:19.719568 31850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.714944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53160 (local address 127.29.168.194:41919)
0808 14:40:19.715434 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.715438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.715450 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:40:19.715494 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.715497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.715514 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.715628 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:19.715804 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.716728 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.718313 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.719053 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.719132 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.719184 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.719440 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.719489 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":109,"threads_started":1}
I20260808 14:40:19.719602 31848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.714809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:41919 (local address 127.0.0.1:53160)
0808 14:40:19.715136 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.715173 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.715235 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.715664 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.715665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.715667 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:19.715718 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.715720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.716844 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.716845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.718203 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.718207 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.719227 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.719228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.719286 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.719289 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.719339 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.719374 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":35,"thread_start_us":61,"threads_started":1}
I20260808 14:40:19.719838 31851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.714973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42152 (local address 127.29.168.195:46775)
0808 14:40:19.715359 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.715363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.715372 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:19.715426 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.715428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.715443 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.715518 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:19.715768 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.716804 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.718312 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.719049 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.719531 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.719590 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.719618 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.719758 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":93,"threads_started":1}
I20260808 14:40:19.720252 31355 tablet_service.cc:1467] Processing CreateTablet for tablet c5faea8bf6474294b168c113613e0c1b (DEFAULT_TABLE table=test-table [id=22a69902521d4c6b97eebea9cae5f3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:19.720294 31545 tablet_service.cc:1467] Processing CreateTablet for tablet c5faea8bf6474294b168c113613e0c1b (DEFAULT_TABLE table=test-table [id=22a69902521d4c6b97eebea9cae5f3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:19.720608 31545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5faea8bf6474294b168c113613e0c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:19.720613 31355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5faea8bf6474294b168c113613e0c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:19.723174 31854 tablet_bootstrap.cc:492] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8: Bootstrap starting.
I20260808 14:40:19.723491 31858 tablet_bootstrap.cc:492] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: Bootstrap starting.
I20260808 14:40:19.723888 31745 tablet_service.cc:1467] Processing CreateTablet for tablet c5faea8bf6474294b168c113613e0c1b (DEFAULT_TABLE table=test-table [id=22a69902521d4c6b97eebea9cae5f3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:19.724143 31854 tablet_bootstrap.cc:654] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:19.724252 31745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5faea8bf6474294b168c113613e0c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:19.724328 31858 tablet_bootstrap.cc:654] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:19.724912 31854 log.cc:824] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:19.724920 31858 log.cc:824] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:19.725777 31858 tablet_bootstrap.cc:492] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: No bootstrap required, opened a new log
I20260808 14:40:19.725821 31854 tablet_bootstrap.cc:492] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8: No bootstrap required, opened a new log
I20260808 14:40:19.725893 31854 ts_tablet_manager.cc:1397] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:40:19.725905 31858 ts_tablet_manager.cc:1397] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:40:19.727530 31854 raft_consensus.cc:348] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.727747 31854 raft_consensus.cc:374] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:19.727797 31854 raft_consensus.cc:729] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bec2c8f2e72344eda2c88d4135eb56b8, State: Initialized, Role: FOLLOWER
I20260808 14:40:19.727918 31854 consensus_queue.cc:260] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.728185 31861 tablet_bootstrap.cc:492] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf: Bootstrap starting.
I20260808 14:40:19.728212 31854 ts_tablet_manager.cc:1428] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:40:19.728194 31858 raft_consensus.cc:348] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.728397 31858 raft_consensus.cc:374] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:19.728418 31446 heartbeater.cc:503] Master 127.29.168.254:37219 was elected leader, sending a full tablet report...
I20260808 14:40:19.728442 31858 raft_consensus.cc:729] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c38dd02fb16493996408a137cc5b5e2, State: Initialized, Role: FOLLOWER
I20260808 14:40:19.728585 31858 consensus_queue.cc:260] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.728767 31861 tablet_bootstrap.cc:654] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:19.728960 31858 ts_tablet_manager.cc:1428] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:40:19.729103 31644 heartbeater.cc:503] Master 127.29.168.254:37219 was elected leader, sending a full tablet report...
I20260808 14:40:19.729491 31861 log.cc:824] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:19.730316 31861 tablet_bootstrap.cc:492] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf: No bootstrap required, opened a new log
I20260808 14:40:19.730376 31861 ts_tablet_manager.cc:1397] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:40:19.731943 31861 raft_consensus.cc:348] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.732065 31861 raft_consensus.cc:374] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:19.732085 31861 raft_consensus.cc:729] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80c6af4bef7b4243ae0b2a5860e959cf, State: Initialized, Role: FOLLOWER
I20260808 14:40:19.732213 31861 consensus_queue.cc:260] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.732556 31835 heartbeater.cc:503] Master 127.29.168.254:37219 was elected leader, sending a full tablet report...
I20260808 14:40:19.732568 31861 ts_tablet_manager.cc:1428] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260808 14:40:19.780985 31645 tablet.cc:2369] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:19.789316 31862 raft_consensus.cc:482] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:19.789412 31862 raft_consensus.cc:504] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.789873 31862 leader_election.cc:288] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c38dd02fb16493996408a137cc5b5e2 (127.29.168.194:41919), 80c6af4bef7b4243ae0b2a5860e959cf (127.29.168.195:46775)
I20260808 14:40:19.793545 31851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.790158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:33191 (local address 127.29.168.195:46775)
0808 14:40:19.790211 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.790213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.790361 (+ 148us) server_negotiation.cc:407] Connection header received
0808 14:40:19.790390 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.790390 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.790397 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.790437 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:19.790617 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.791245 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.792652 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.793182 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.793260 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.793268 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.793429 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.793483 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:40:19.793545 31850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.790113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:47197 (local address 127.29.168.194:41919)
0808 14:40:19.790151 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.790153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.790162 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:19.790244 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.790245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.790256 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.790297 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:19.790483 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.791191 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.792652 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.793198 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.793260 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.793268 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.793429 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.793482 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:19.793570 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.790063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:41919 (local address 127.29.168.193:47197)
0808 14:40:19.790115 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.790126 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.790168 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.790331 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.790332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.790334 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:19.790409 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.790410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.791275 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.791291 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.792563 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.792566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.793277 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.793278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.793361 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.793363 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.793409 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.793465 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":30}
I20260808 14:40:19.793576 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.790101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:46775 (local address 127.29.168.193:33191)
0808 14:40:19.790258 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:19.790268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:19.790348 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:19.790456 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:19.790457 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:19.790458 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:19.790550 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.790551 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.791317 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.791317 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.792563 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:19.792566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.793277 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.793278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:19.793350 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.793354 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:19.793410 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:40:19.793465 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":7,"thread_start_us":108,"threads_started":1}
I20260808 14:40:19.793931 31571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5faea8bf6474294b168c113613e0c1b" candidate_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c38dd02fb16493996408a137cc5b5e2" is_pre_election: true
I20260808 14:40:19.794087 31571 raft_consensus.cc:2454] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bec2c8f2e72344eda2c88d4135eb56b8 in term 0.
I20260808 14:40:19.794080 31772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5faea8bf6474294b168c113613e0c1b" candidate_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" is_pre_election: true
I20260808 14:40:19.794263 31772 raft_consensus.cc:2454] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bec2c8f2e72344eda2c88d4135eb56b8 in term 0.
I20260808 14:40:19.794445 31292 leader_election.cc:302] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c38dd02fb16493996408a137cc5b5e2, bec2c8f2e72344eda2c88d4135eb56b8; no voters:
I20260808 14:40:19.794595 31862 raft_consensus.cc:2781] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:19.794689 31862 raft_consensus.cc:482] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:19.794721 31862 raft_consensus.cc:3037] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:19.795411 31862 raft_consensus.cc:504] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.795542 31862 leader_election.cc:288] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c38dd02fb16493996408a137cc5b5e2 (127.29.168.194:41919), 80c6af4bef7b4243ae0b2a5860e959cf (127.29.168.195:46775)
I20260808 14:40:19.795691 31772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5faea8bf6474294b168c113613e0c1b" candidate_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80c6af4bef7b4243ae0b2a5860e959cf"
I20260808 14:40:19.795766 31772 raft_consensus.cc:3037] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:19.795737 31571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5faea8bf6474294b168c113613e0c1b" candidate_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c38dd02fb16493996408a137cc5b5e2"
I20260808 14:40:19.795835 31571 raft_consensus.cc:3037] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:19.796464 31571 raft_consensus.cc:2454] T c5faea8bf6474294b168c113613e0c1b P 2c38dd02fb16493996408a137cc5b5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bec2c8f2e72344eda2c88d4135eb56b8 in term 1.
I20260808 14:40:19.796466 31772 raft_consensus.cc:2454] T c5faea8bf6474294b168c113613e0c1b P 80c6af4bef7b4243ae0b2a5860e959cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bec2c8f2e72344eda2c88d4135eb56b8 in term 1.
I20260808 14:40:19.796658 31292 leader_election.cc:302] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c38dd02fb16493996408a137cc5b5e2, bec2c8f2e72344eda2c88d4135eb56b8; no voters:
I20260808 14:40:19.796742 31862 raft_consensus.cc:2781] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:19.796885 31862 raft_consensus.cc:686] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [term 1 LEADER]: Becoming Leader. State: Replica: bec2c8f2e72344eda2c88d4135eb56b8, State: Running, Role: LEADER
I20260808 14:40:19.797008 31862 consensus_queue.cc:237] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } }
I20260808 14:40:19.797856 31177 catalog_manager.cc:5495] T c5faea8bf6474294b168c113613e0c1b P bec2c8f2e72344eda2c88d4135eb56b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to bec2c8f2e72344eda2c88d4135eb56b8 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c38dd02fb16493996408a137cc5b5e2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bec2c8f2e72344eda2c88d4135eb56b8" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80c6af4bef7b4243ae0b2a5860e959cf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46775 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:19.813884 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.806834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53350 (local address 127.29.168.193:45523)
0808 14:40:19.806926 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.806928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.806966 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:40:19.807018 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.807018 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.807026 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.807073 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.807576 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.808076 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.808780 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.808937 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.808983 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.811219 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.811228 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.811228 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.811243 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.812644 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.813013 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.813016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.813016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.813088 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.813300 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.813301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.813301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.813437 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.813615 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.813652 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.813723 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:19.836460 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.830232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53352 (local address 127.29.168.193:45523)
0808 14:40:19.830300 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.830302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.830373 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:40:19.830407 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.830407 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.830415 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.830464 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.830902 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.831344 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.832038 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.832212 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.832263 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.834166 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.834167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.834167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.834173 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.835300 (+ 1127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.835666 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.835667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.835667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.835722 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.835925 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.835926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.835926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.836031 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.836140 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.836302 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.836370 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:19.857309 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:19.850910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.29.168.193:45523)
0808 14:40:19.850967 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:19.850969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:19.851043 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:40:19.851110 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:19.851111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:19.851120 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:19.851187 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:19.851798 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.852233 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.852926 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:19.853100 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:19.853178 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:19.855105 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:19.855107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:19.855107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:19.855113 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:19.856179 (+ 1066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.856498 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.856499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.856500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.856551 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:19.856756 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:19.856756 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:19.856757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:19.856887 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:19.856980 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:19.857145 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:40:19.857216 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 14:40:19.858018 31326 tablet_service.cc:2908] Rejecting scan request for tablet c5faea8bf6474294b168c113613e0c1b: Uninitialized: clean time has not yet been initialized
I20260808 14:40:19.859032 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31266
I20260808 14:40:19.872262 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31451
I20260808 14:40:19.879966 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31653
I20260808 14:40:19.891889 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31132
2026-08-08T14:40:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2134 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31887](info): set up 2 sockets
Aug 08 14:40:19 dist-test-slave-mjjr krb5kdc[31887](info): commencing operation
krb5kdc: starting...
W20260808 14:40:21.062489 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:21.173674 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33151
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:21.256282 31903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:21.256471 31903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:21.256521 31903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:21.257606 31903 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:21.257670 31903 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:40:21.257692 31903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:21.257721 31903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:21.257751 31903 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:21.257776 31903 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:21.259210 31903 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33151
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:21.259486 31903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:21.259747 31903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:21.264415 31913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:21.264467 31912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:21.264547 31903 server_base.cc:1034] running on GCE node
W20260808 14:40:21.264448 31916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:21.264895 31903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:21.265205 31903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:21.266374 31903 hybrid_clock.cc:648] HybridClock initialized: now 1786200021266364 us; error 44 us; skew 500 ppm
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:21.269099 31903 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:21.269526 31903 webserver.cc:460] Webserver started at http://127.29.168.254:44877/ using document root <none> and password file <none>
I20260808 14:40:21.269696 31903 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:21.269733 31903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:21.269819 31903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:21.270732 31903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "c85cd1b3c27042038789eb5e4cd94687"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "16f19bfb72b12dad93bf9ed44774026a"
server_key_iv: "3173e28cecb56075d43e9326ea287845"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.271008 31903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "c85cd1b3c27042038789eb5e4cd94687"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "16f19bfb72b12dad93bf9ed44774026a"
server_key_iv: "3173e28cecb56075d43e9326ea287845"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.272311 31903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:21.272974 31926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.273138 31903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:21.273241 31903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "c85cd1b3c27042038789eb5e4cd94687"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "16f19bfb72b12dad93bf9ed44774026a"
server_key_iv: "3173e28cecb56075d43e9326ea287845"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.273319 31903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:21.284482 31903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:21.286088 31903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:21.286240 31903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:21.291067 31903 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33151
I20260808 14:40:21.291168 32006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33151 every 8 connection(s)
I20260808 14:40:21.291478 31903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:21.292128 32007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.294193 32007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: Bootstrap starting.
I20260808 14:40:21.294705 32007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.294945 32007 log.cc:824] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:21.295601 32007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: No bootstrap required, opened a new log
I20260808 14:40:21.297624 32007 raft_consensus.cc:348] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c85cd1b3c27042038789eb5e4cd94687" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33151 } }
I20260808 14:40:21.297742 32007 raft_consensus.cc:374] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.297761 32007 raft_consensus.cc:729] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cd1b3c27042038789eb5e4cd94687, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.297890 32007 consensus_queue.cc:260] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c85cd1b3c27042038789eb5e4cd94687" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33151 } }
I20260808 14:40:21.297978 32007 raft_consensus.cc:388] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:21.298012 32007 raft_consensus.cc:482] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:21.297994 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31903
I20260808 14:40:21.298061 32007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.298081 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:21.298239 30371 external_mini_cluster.cc:1428] Setting key 3cdbb1d1589b0787b995b4fe6d5e2840
I20260808 14:40:21.298727 32007 raft_consensus.cc:504] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c85cd1b3c27042038789eb5e4cd94687" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33151 } }
I20260808 14:40:21.298864 32007 leader_election.cc:302] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c85cd1b3c27042038789eb5e4cd94687; no voters:
I20260808 14:40:21.299041 32007 leader_election.cc:288] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:21.299083 32012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:21.299294 32012 raft_consensus.cc:686] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [term 1 LEADER]: Becoming Leader. State: Replica: c85cd1b3c27042038789eb5e4cd94687, State: Running, Role: LEADER
I20260808 14:40:21.299314 32007 sys_catalog.cc:564] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:21.299391 32012 consensus_queue.cc:237] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c85cd1b3c27042038789eb5e4cd94687" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33151 } }
I20260808 14:40:21.299783 32012 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c85cd1b3c27042038789eb5e4cd94687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c85cd1b3c27042038789eb5e4cd94687" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33151 } } }
I20260808 14:40:21.299925 32012 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:21.300107 32012 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c85cd1b3c27042038789eb5e4cd94687. Latest consensus state: current_term: 1 leader_uuid: "c85cd1b3c27042038789eb5e4cd94687" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c85cd1b3c27042038789eb5e4cd94687" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33151 } } }
I20260808 14:40:21.300172 32012 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687 [sys.catalog]: This master's current role is: LEADER
W20260808 14:40:21.301196 32038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:21.301270 32038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:21.301378 32025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:21.301556 32025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:21.303119 32025 catalog_manager.cc:1347] Generated new cluster ID: b4436437ad8e449fbcbc4f11f879ad81
I20260808 14:40:21.303166 32025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:21.308604 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.298657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44424 (local address 127.29.168.254:33151)
0808 14:40:21.298833 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.298842 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.298870 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:40:21.298979 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.298985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.299032 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.299195 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.300004 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.301539 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.302503 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.303057 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.303169 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.305375 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.305379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.305379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.305390 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.307029 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.307418 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.307421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.307421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.307533 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.307803 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.307804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.307804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.308022 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.308178 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.308279 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.308413 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260808 14:40:21.312664 32025 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:21.313117 32025 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:21.319713 32025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: Generated new TSK 0
I20260808 14:40:21.319890 32025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:21.348709 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33151
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:21.426679 32044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:21.426868 32044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:21.426891 32044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:21.428082 32044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:21.428135 32044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:21.428155 32044 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:21.428196 32044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:21.429589 32044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:33151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:21.429831 32044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:21.430052 32044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:21.434724 32050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:21.434754 32053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:21.434746 32051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:21.434969 32044 server_base.cc:1034] running on GCE node
I20260808 14:40:21.435166 32044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:21.435389 32044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:21.436540 32044 hybrid_clock.cc:648] HybridClock initialized: now 1786200021436531 us; error 29 us; skew 500 ppm
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:21.439194 32044 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:21.439581 32044 webserver.cc:460] Webserver started at http://127.29.168.193:39277/ using document root <none> and password file <none>
I20260808 14:40:21.439841 32044 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:21.439908 32044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:21.440037 32044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:21.441007 32044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "d360a60df72d4d9b929a50b388a3814d"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "dba9474ae953542ea645cd34db0b820f"
server_key_iv: "3498f4959080ebc91d3eef228ab8b350"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.441393 32044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "d360a60df72d4d9b929a50b388a3814d"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "dba9474ae953542ea645cd34db0b820f"
server_key_iv: "3498f4959080ebc91d3eef228ab8b350"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.442682 32044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:21.443382 32063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.443548 32044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:21.443641 32044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "d360a60df72d4d9b929a50b388a3814d"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "dba9474ae953542ea645cd34db0b820f"
server_key_iv: "3498f4959080ebc91d3eef228ab8b350"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.443742 32044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:21.453999 32044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:21.456195 32044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:21.456341 32044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:21.456768 32044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:21.456833 32044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.456863 32044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:21.456889 32044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.463454 32044 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:39919
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:21.463558 32225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:39919 every 8 connection(s)
I20260808 14:40:21.463898 32044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:21.466403 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.457424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:60827 (local address 127.29.168.254:33151)
0808 14:40:21.457466 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.457467 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.457675 (+ 208us) server_negotiation.cc:407] Connection header received
0808 14:40:21.458159 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.458160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.458175 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.458246 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.459028 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.459820 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.461209 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.461561 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.461639 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.464141 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.464142 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.464142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.464150 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.465377 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.465728 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.465729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.465729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.465779 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.465934 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.465935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.465935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.466024 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.466069 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.466286 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.466346 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:21.466609 32076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.457429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.29.168.193:60827)
0808 14:40:21.457575 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.457604 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.458020 (+ 416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.458322 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.458336 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.458669 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.458921 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.458925 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.459935 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.459937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.461120 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.461124 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.461661 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.461661 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.461754 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.462206 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.462234 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.464023 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.465451 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.465457 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.465458 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.465662 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.465820 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.465821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.465821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.465899 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.466076 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.466081 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.466179 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.466273 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.466371 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260808 14:40:21.467087 32227 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33151
I20260808 14:40:21.467170 32227 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:21.467360 32227 heartbeater.cc:511] Master 127.29.168.254:33151 requested a full tablet report, sending...
I20260808 14:40:21.467911 31947 ts_manager.cc:194] Registered new tserver with Master: d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919)
I20260808 14:40:21.468679 31947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:60827
I20260808 14:40:21.473342 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 32044
I20260808 14:40:21.473443 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:21.473435 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.468176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.29.168.193:43571)
0808 14:40:21.468311 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.468321 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.468377 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.468993 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.468994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.469185 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.469244 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.469246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.469807 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.469808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.470226 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.470227 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.470500 (+ 273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.470501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.470548 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.470923 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.470927 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.471159 (+ 232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.472522 (+ 1363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.472522 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.472523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.472691 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.472896 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.472897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.472897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.472987 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.473179 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.473180 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.473216 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.473270 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.473347 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260808 14:40:21.473469 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.468273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:43571 (local address 127.29.168.254:33151)
0808 14:40:21.468831 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.468833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.468839 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:21.468878 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.468878 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.468887 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.468979 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.469316 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.469703 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.470288 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.470444 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.470487 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.471242 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.471243 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.471243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.471248 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.472405 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.472785 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.472786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.472786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.472837 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.473046 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.473047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.473047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.473126 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.473190 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.473307 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.473379 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537}
I20260808 14:40:21.473603 30371 external_mini_cluster.cc:1428] Setting key f1836d60c3797e048c6fe71ef121a825
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:21.496656 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33151
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:21.574313 32244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:21.574498 32244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:21.574522 32244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:21.575672 32244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:21.575709 32244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:21.575728 32244 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:21.575744 32244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:21.577134 32244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:33151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:21.577284 32244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:21.577431 32244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:21.582280 32253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:21.582211 32250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:21.582228 32251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:21.582304 32244 server_base.cc:1034] running on GCE node
I20260808 14:40:21.582603 32244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:21.582839 32244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:21.584014 32244 hybrid_clock.cc:648] HybridClock initialized: now 1786200021583999 us; error 41 us; skew 500 ppm
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:21.586175 32244 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:21.586593 32244 webserver.cc:460] Webserver started at http://127.29.168.194:35669/ using document root <none> and password file <none>
I20260808 14:40:21.586814 32244 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:21.586881 32244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:21.587033 32244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:21.588101 32244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "2a67ad3ac30f4fd8a7c442750b1f7098"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "bf3f31787375451c12a66a46a2fad9d5"
server_key_iv: "a1371d2b82bd3573a36470438930dce6"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.588485 32244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "2a67ad3ac30f4fd8a7c442750b1f7098"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "bf3f31787375451c12a66a46a2fad9d5"
server_key_iv: "a1371d2b82bd3573a36470438930dce6"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.589720 32244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:21.590404 32263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.590699 32244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:21.590793 32244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "2a67ad3ac30f4fd8a7c442750b1f7098"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "bf3f31787375451c12a66a46a2fad9d5"
server_key_iv: "a1371d2b82bd3573a36470438930dce6"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.590842 32244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:21.609165 32244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:21.610694 32244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:21.610805 32244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:21.611258 32244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:21.611335 32244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.611398 32244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:21.611430 32244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.618264 32244 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:43171
I20260808 14:40:21.618358 32434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:43171 every 8 connection(s)
I20260808 14:40:21.618631 32244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:21.620954 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 32244
I20260808 14:40:21.621057 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:21.621233 30371 external_mini_cluster.cc:1428] Setting key 95151b52595f6f36388c406c88d0f3ff
I20260808 14:40:21.621937 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.611690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:37849 (local address 127.29.168.254:33151)
0808 14:40:21.611936 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.611939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.612062 (+ 123us) server_negotiation.cc:407] Connection header received
0808 14:40:21.612720 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.612722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.612735 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.612807 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.613549 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.614311 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.615821 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.616076 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.616160 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.619294 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.619295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.619296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.619302 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.620474 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.620871 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.620872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.620873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.620941 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.621173 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.621174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.621174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.621340 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.621421 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.621746 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.621834 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260808 14:40:21.622118 32274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.611627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.29.168.194:37849)
0808 14:40:21.611888 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.611937 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.612602 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.612878 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.612882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.613192 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.613437 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.613442 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.614424 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.614424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.615740 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.615744 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.616184 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.616185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.616321 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.617528 (+ 1207us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.617538 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.619212 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.620545 (+ 1333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.620551 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.620553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.620796 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.621012 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.621013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.621013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.621106 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.621433 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.621439 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.621611 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.621719 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.621901 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":88,"threads_started":1}
I20260808 14:40:21.623528 32436 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33151
I20260808 14:40:21.623602 32436 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:21.623811 32436 heartbeater.cc:511] Master 127.29.168.254:33151 requested a full tablet report, sending...
I20260808 14:40:21.624177 31948 ts_manager.cc:194] Registered new tserver with Master: 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171)
I20260808 14:40:21.624675 31948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:37849
I20260808 14:40:21.630021 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.624282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:52715 (local address 127.29.168.254:33151)
0808 14:40:21.624334 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.624335 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.624342 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:21.624359 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.624360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.624368 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.624436 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.624716 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.625219 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.626283 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.626458 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.626526 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.627440 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.627441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.627442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.627448 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.628835 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.629186 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.629187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.629188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.629260 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.629475 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.629477 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.629477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.629625 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.629700 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.629867 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.629937 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:40:21.630023 32443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.623718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.29.168.194:52715)
0808 14:40:21.623857 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.623868 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.623914 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.624442 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.624443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.624605 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.624645 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.624647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.625306 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.625307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.626193 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.626196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.626543 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.626544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.626635 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.627044 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.627049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.627331 (+ 282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.628936 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.628937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.628937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.629106 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.629341 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.629342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.629342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.629403 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.629705 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.629706 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.629750 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.629829 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.629930 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:21.647487 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33151
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:21.725485 32446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:21.725651 32446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:21.725672 32446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:21.726749 32446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:21.726783 32446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:21.726802 32446 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:21.726819 32446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:21.728152 32446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:33151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:21.728325 32446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:21.728478 32446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:21.733366 32453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:21.733363 32455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:21.733492 32446 server_base.cc:1034] running on GCE node
W20260808 14:40:21.733359 32452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:21.733783 32446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:21.734037 32446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:21.735193 32446 hybrid_clock.cc:648] HybridClock initialized: now 1786200021735174 us; error 35 us; skew 500 ppm
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:21.737551 32446 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:21.738022 32446 webserver.cc:460] Webserver started at http://127.29.168.195:38043/ using document root <none> and password file <none>
I20260808 14:40:21.738233 32446 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:21.738291 32446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:21.738426 32446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:21.739316 32446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "6c5ae67ff0ef4e4da0368596d975d7c0"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "6c108fd3c955f1612fa21b5ef0ec8631"
server_key_iv: "0d6c2e0c0d2d066d102405dec562941c"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.739703 32446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "6c5ae67ff0ef4e4da0368596d975d7c0"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "6c108fd3c955f1612fa21b5ef0ec8631"
server_key_iv: "0d6c2e0c0d2d066d102405dec562941c"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.740963 32446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:21.741698 32463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.741899 32446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:21.741995 32446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "6c5ae67ff0ef4e4da0368596d975d7c0"
format_stamp: "Formatted at 2026-08-08 14:40:21 on dist-test-slave-mjjr"
server_key: "6c108fd3c955f1612fa21b5ef0ec8631"
server_key_iv: "0d6c2e0c0d2d066d102405dec562941c"
server_key_version: "encryptionkey@0"
I20260808 14:40:21.742079 32446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:21.758261 32446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:21.759865 32446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:21.760038 32446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:21.760583 32446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:21.760645 32446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.760675 32446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:21.760694 32446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:21.767890 32446 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:44609
I20260808 14:40:21.767980 32649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:44609 every 8 connection(s)
I20260808 14:40:21.768338 32446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:21.770292 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.760906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:40407 (local address 127.29.168.254:33151)
0808 14:40:21.760965 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.760967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.761137 (+ 170us) server_negotiation.cc:407] Connection header received
0808 14:40:21.761616 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.761617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.761632 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.761682 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.762358 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.763115 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.764774 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.764977 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.765069 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.767754 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.767756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.767756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.767766 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.769266 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.769585 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.769585 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.769586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.769634 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.769844 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.769845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.769845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.769931 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.769974 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.770161 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.770233 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:21.770426 32478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.760890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.29.168.195:40407)
0808 14:40:21.761027 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.761064 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.761508 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.761742 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.761746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.762073 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.762264 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.762268 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.763228 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.763229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.764673 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.764676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.765092 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.765093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.765227 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.765689 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.765705 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.767619 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.769330 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.769335 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.769336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.769523 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.769698 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.769698 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.769698 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.769792 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.769978 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.769982 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.770069 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.770135 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.770245 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":74,"threads_started":1}
I20260808 14:40:21.770911 32650 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33151
I20260808 14:40:21.770992 32650 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:21.771145 32650 heartbeater.cc:511] Master 127.29.168.254:33151 requested a full tablet report, sending...
I20260808 14:40:21.771548 31947 ts_manager.cc:194] Registered new tserver with Master: 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195:44609)
I20260808 14:40:21.771958 31947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:40407
I20260808 14:40:21.772154 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 32446
I20260808 14:40:21.772266 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:21.772461 30371 external_mini_cluster.cc:1428] Setting key 463aa5f9e37fdb4b05883174dac6ac1b
I20260808 14:40:21.773392 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:40:21.778252 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.772612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.29.168.195:48405)
0808 14:40:21.772803 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.772815 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.772982 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.773098 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.773098 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.773314 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.773379 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.773380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.774014 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.774015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.774511 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.774512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.774864 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.774865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.774941 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.775366 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.775371 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.775671 (+ 300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.777160 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.777161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.777162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.777338 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.777584 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.777585 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.777585 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.777657 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.777945 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.777946 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.777988 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.778065 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.778163 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260808 14:40:21.778250 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.772044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:48405 (local address 127.29.168.254:33151)
0808 14:40:21.772090 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.772092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.772897 (+ 805us) server_negotiation.cc:407] Connection header received
0808 14:40:21.773029 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.773030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.773041 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.773092 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.773455 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.773921 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.774606 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.774788 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.774865 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.775739 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.775741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.775741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.775748 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.777075 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.777412 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.777413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.777413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.777477 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.777723 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.777724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.777724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.777834 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.777913 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.778102 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.778168 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:21.796139 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.789722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44436 (local address 127.29.168.254:33151)
0808 14:40:21.789778 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.789780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.789788 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:21.789849 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.789850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.789861 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.789919 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.790410 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.790841 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.791529 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.791785 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.791859 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.793940 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.793941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.793941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.793946 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.795119 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.795487 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.795488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.795488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.795534 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.795733 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.795734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.795734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.795832 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.795899 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.795997 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.796049 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:40:21.797485 31947 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:21.798949 31947 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:21.805502 32679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.801464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40946 (local address 127.29.168.195:44609)
0808 14:40:21.801727 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.801731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.801744 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:40:21.801977 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.801980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.801994 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.802059 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.802262 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.803350 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.804423 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.805006 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.805122 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.805173 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.805357 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.805398 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":98,"threads_started":1}
I20260808 14:40:21.805517 32671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.801208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44609 (local address 127.0.0.1:40946)
0808 14:40:21.801649 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.801688 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.801756 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.802110 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.802111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.802112 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.802179 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.802180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.803446 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.803447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.804354 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.804356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.805124 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.805125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.805205 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.805217 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.805339 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.805413 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":29,"thread_start_us":50,"threads_started":1}
I20260808 14:40:21.805696 32678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.801442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38524 (local address 127.29.168.194:43171)
0808 14:40:21.801638 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.801643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.801887 (+ 244us) server_negotiation.cc:407] Connection header received
0808 14:40:21.801933 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.801936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.801952 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.802027 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.802258 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.802977 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.804350 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.805033 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.805113 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.805158 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.805556 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.805598 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":114,"threads_started":1}
I20260808 14:40:21.805496 32677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.801306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43171 (local address 127.0.0.1:38524)
0808 14:40:21.801651 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.801688 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.801816 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.802096 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.802097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.802099 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.802163 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.802165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.803098 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.803099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.804254 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.804257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.805192 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.805193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.805259 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.805282 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.805332 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.805409 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":1,"thread_start_us":71,"threads_started":1}
I20260808 14:40:21.805739 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.801264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:39919 (local address 127.0.0.1:50334)
0808 14:40:21.801662 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.801696 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.801772 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.802089 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.802092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.802094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.802244 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.802247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.803516 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.803517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.804555 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.804557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.805523 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.805524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.805580 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.805583 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.805629 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.805667 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":47,"thread_start_us":38,"threads_started":1}
I20260808 14:40:21.806042 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.801450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.29.168.193:39919)
0808 14:40:21.801843 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.801847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.801857 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:21.801897 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.801900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.801918 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.801999 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.802329 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.803426 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.804639 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.805379 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.805441 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.805489 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.805887 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.805937 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":114,"threads_started":1}
I20260808 14:40:21.806628 32336 tablet_service.cc:1467] Processing CreateTablet for tablet 52e54b841b4c4645a5228c771d57f7ff (DEFAULT_TABLE table=test-table [id=3b75a62654c34db789bf0a564728f200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:21.806854 32137 tablet_service.cc:1467] Processing CreateTablet for tablet 52e54b841b4c4645a5228c771d57f7ff (DEFAULT_TABLE table=test-table [id=3b75a62654c34db789bf0a564728f200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:21.807029 32336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e54b841b4c4645a5228c771d57f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.807209 32137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e54b841b4c4645a5228c771d57f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.807994 32549 tablet_service.cc:1467] Processing CreateTablet for tablet 52e54b841b4c4645a5228c771d57f7ff (DEFAULT_TABLE table=test-table [id=3b75a62654c34db789bf0a564728f200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:21.808295 32549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e54b841b4c4645a5228c771d57f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.810688 32683 tablet_bootstrap.cc:492] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Bootstrap starting.
I20260808 14:40:21.810994 32684 tablet_bootstrap.cc:492] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Bootstrap starting.
I20260808 14:40:21.811785 32684 tablet_bootstrap.cc:654] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.811821 32683 tablet_bootstrap.cc:654] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.811826 32685 tablet_bootstrap.cc:492] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Bootstrap starting.
I20260808 14:40:21.812146 32684 log.cc:824] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:21.812165 32683 log.cc:824] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:21.812578 32685 tablet_bootstrap.cc:654] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.812906 32685 log.cc:824] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:21.812961 32684 tablet_bootstrap.cc:492] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: No bootstrap required, opened a new log
I20260808 14:40:21.812961 32683 tablet_bootstrap.cc:492] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: No bootstrap required, opened a new log
I20260808 14:40:21.813016 32684 ts_tablet_manager.cc:1397] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:40:21.813016 32683 ts_tablet_manager.cc:1397] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:40:21.813568 32685 tablet_bootstrap.cc:492] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: No bootstrap required, opened a new log
I20260808 14:40:21.813652 32685 ts_tablet_manager.cc:1397] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:21.814842 32684 raft_consensus.cc:348] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.814816 32683 raft_consensus.cc:348] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.814970 32683 raft_consensus.cc:374] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.814970 32684 raft_consensus.cc:374] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.815003 32683 raft_consensus.cc:729] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5ae67ff0ef4e4da0368596d975d7c0, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.815003 32684 raft_consensus.cc:729] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a67ad3ac30f4fd8a7c442750b1f7098, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.815119 32684 consensus_queue.cc:260] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.815079 32685 raft_consensus.cc:348] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.815189 32683 consensus_queue.cc:260] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.815279 32685 raft_consensus.cc:374] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.815346 32685 raft_consensus.cc:729] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d360a60df72d4d9b929a50b388a3814d, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.815374 32684 ts_tablet_manager.cc:1428] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:40:21.815446 32436 heartbeater.cc:503] Master 127.29.168.254:33151 was elected leader, sending a full tablet report...
I20260808 14:40:21.815536 32685 consensus_queue.cc:260] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.815587 32683 ts_tablet_manager.cc:1428] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:40:21.815828 32650 heartbeater.cc:503] Master 127.29.168.254:33151 was elected leader, sending a full tablet report...
I20260808 14:40:21.815848 32685 ts_tablet_manager.cc:1428] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:40:21.815872 32227 heartbeater.cc:503] Master 127.29.168.254:33151 was elected leader, sending a full tablet report...
I20260808 14:40:21.836779 32692 raft_consensus.cc:482] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:21.836858 32692 raft_consensus.cc:504] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.837107 32692 leader_election.cc:288] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195:44609), 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171)
I20260808 14:40:21.839793 32679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.837377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:51827 (local address 127.29.168.195:44609)
0808 14:40:21.837413 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.837414 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.837423 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:21.837448 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.837449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.837458 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.837524 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.837713 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.838154 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.839050 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.839409 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.839487 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.839494 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.839693 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.839723 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:40:21.839794 32076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.837315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44609 (local address 127.29.168.193:51827)
0808 14:40:21.837353 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.837363 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.837398 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.837563 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.837564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.837566 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.837630 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.837632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.838233 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.838234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.838963 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.838964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.839484 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.839485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.839568 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.839571 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.839668 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.839706 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 14:40:21.840122 32678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.837400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:59569 (local address 127.29.168.194:43171)
0808 14:40:21.837444 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.837446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.837686 (+ 240us) server_negotiation.cc:407] Connection header received
0808 14:40:21.837758 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.837759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.837768 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.837820 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.837969 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.838397 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.839274 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.839608 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.839733 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.839758 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.840021 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.840063 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:40:21.840150 32695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.837315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43171 (local address 127.29.168.193:59569)
0808 14:40:21.837617 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.837626 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.837693 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.837827 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.837828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.837829 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.837900 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.837901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.838475 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.838476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.839186 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.839188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.839753 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.839754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.839865 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.839870 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.839994 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.840040 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":128,"thread_start_us":132,"threads_started":1}
I20260808 14:40:21.840195 32583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e54b841b4c4645a5228c771d57f7ff" candidate_uuid: "d360a60df72d4d9b929a50b388a3814d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" is_pre_election: true
I20260808 14:40:21.840317 32583 raft_consensus.cc:2454] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d360a60df72d4d9b929a50b388a3814d in term 0.
I20260808 14:40:21.840546 32064 leader_election.cc:302] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5ae67ff0ef4e4da0368596d975d7c0, d360a60df72d4d9b929a50b388a3814d; no voters:
I20260808 14:40:21.840626 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e54b841b4c4645a5228c771d57f7ff" candidate_uuid: "d360a60df72d4d9b929a50b388a3814d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" is_pre_election: true
I20260808 14:40:21.840683 32692 raft_consensus.cc:2781] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:21.840727 32692 raft_consensus.cc:482] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:21.840751 32692 raft_consensus.cc:3037] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.840772 32366 raft_consensus.cc:2454] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d360a60df72d4d9b929a50b388a3814d in term 0.
I20260808 14:40:21.841753 32692 raft_consensus.cc:504] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.841907 32692 leader_election.cc:288] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [CANDIDATE]: Term 1 election: Requested vote from peers 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195:44609), 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171)
I20260808 14:40:21.842042 32583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e54b841b4c4645a5228c771d57f7ff" candidate_uuid: "d360a60df72d4d9b929a50b388a3814d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0"
I20260808 14:40:21.842060 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e54b841b4c4645a5228c771d57f7ff" candidate_uuid: "d360a60df72d4d9b929a50b388a3814d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098"
I20260808 14:40:21.842123 32366 raft_consensus.cc:3037] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.842123 32583 raft_consensus.cc:3037] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.842914 32583 raft_consensus.cc:2454] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d360a60df72d4d9b929a50b388a3814d in term 1.
I20260808 14:40:21.842914 32366 raft_consensus.cc:2454] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d360a60df72d4d9b929a50b388a3814d in term 1.
I20260808 14:40:21.843081 32065 leader_election.cc:302] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a67ad3ac30f4fd8a7c442750b1f7098, d360a60df72d4d9b929a50b388a3814d; no voters:
I20260808 14:40:21.843195 32692 raft_consensus.cc:2781] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:21.843330 32692 raft_consensus.cc:686] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 1 LEADER]: Becoming Leader. State: Replica: d360a60df72d4d9b929a50b388a3814d, State: Running, Role: LEADER
I20260808 14:40:21.843443 32692 consensus_queue.cc:237] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.844269 31946 catalog_manager.cc:5495] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d reported cstate change: term changed from 0 to 1, leader changed from <none> to d360a60df72d4d9b929a50b388a3814d (127.29.168.193). New cstate: current_term: 1 leader_uuid: "d360a60df72d4d9b929a50b388a3814d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } health_report { overall_health: HEALTHY } } }
I20260808 14:40:21.851183 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.849148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50342 (local address 127.29.168.193:39919)
0808 14:40:21.849203 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.849205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.849230 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:40:21.849309 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.849309 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.849323 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.849376 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:21.849497 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.849899 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.850564 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.850731 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.850774 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.850937 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:21.851008 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:21.851058 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.851098 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.851113 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:40:21.852842 32583 raft_consensus.cc:1261] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Refusing update from remote peer d360a60df72d4d9b929a50b388a3814d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:21.852854 32366 raft_consensus.cc:1261] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Refusing update from remote peer d360a60df72d4d9b929a50b388a3814d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:21.853124 32692 consensus_queue.cc:1035] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:21.853237 32696 consensus_queue.cc:1035] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:21.856073 32700 mvcc.cc:205] Tried to move back new op lower bound from 7316275289506807808 to 7316275289471414272. Current Snapshot: MvccSnapshot[applied={T|T < 7316275289506807808}]
I20260808 14:40:21.856423 32699 mvcc.cc:205] Tried to move back new op lower bound from 7316275289506807808 to 7316275289471414272. Current Snapshot: MvccSnapshot[applied={T|T < 7316275289506807808 or (T in {7316275289506807808})}]
I20260808 14:40:21.859251 31946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:21.859352 31946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:21.860230 31946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: Sending DeleteTablet for 3 replicas of tablet 52e54b841b4c4645a5228c771d57f7ff
I20260808 14:40:21.860656 32336 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e54b841b4c4645a5228c771d57f7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:21 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:38524
I20260808 14:40:21.860886 32716 tablet_replica.cc:330] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: stopping tablet replica
I20260808 14:40:21.860846 31946 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:40:21.860989 32716 raft_consensus.cc:2229] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 14:40:21.860983 31946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:21.861241 32716 raft_consensus.cc:2258] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:21.861828 32716 ts_tablet_manager.cc:1905] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:21.862459 32336 tablet_service.cc:1467] Processing CreateTablet for tablet 015518b7361546e29486ff2f91168914 (DEFAULT_TABLE table=test-table [id=79daa342aedf4b9fbf56cdd960b155cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:21.862542 32336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015518b7361546e29486ff2f91168914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.862550 32547 tablet_service.cc:1467] Processing CreateTablet for tablet 015518b7361546e29486ff2f91168914 (DEFAULT_TABLE table=test-table [id=79daa342aedf4b9fbf56cdd960b155cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:21.862672 32547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015518b7361546e29486ff2f91168914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.863304 32684 tablet_bootstrap.cc:492] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Bootstrap starting.
I20260808 14:40:21.863400 32549 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e54b841b4c4645a5228c771d57f7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:21 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:40946
I20260808 14:40:21.863734 32137 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e54b841b4c4645a5228c771d57f7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:21 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:50334
I20260808 14:40:21.863792 32684 tablet_bootstrap.cc:654] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.863992 32136 tablet_service.cc:1467] Processing CreateTablet for tablet 015518b7361546e29486ff2f91168914 (DEFAULT_TABLE table=test-table [id=79daa342aedf4b9fbf56cdd960b155cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:21.864089 32136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015518b7361546e29486ff2f91168914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.864461 32683 tablet_bootstrap.cc:492] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Bootstrap starting.
I20260808 14:40:21.865057 32683 tablet_bootstrap.cc:654] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.865687 32685 tablet_bootstrap.cc:492] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Bootstrap starting.
I20260808 14:40:21.865854 32683 tablet_bootstrap.cc:492] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: No bootstrap required, opened a new log
I20260808 14:40:21.865898 32683 ts_tablet_manager.cc:1397] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:21.866187 32685 tablet_bootstrap.cc:654] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.866540 32683 raft_consensus.cc:348] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.866662 32683 raft_consensus.cc:374] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.866688 32683 raft_consensus.cc:729] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5ae67ff0ef4e4da0368596d975d7c0, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.866776 32683 consensus_queue.cc:260] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.866930 32683 ts_tablet_manager.cc:1428] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:21.867096 32685 tablet_bootstrap.cc:492] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: No bootstrap required, opened a new log
I20260808 14:40:21.867143 32685 ts_tablet_manager.cc:1397] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:21.867281 32685 raft_consensus.cc:348] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.867380 32685 raft_consensus.cc:374] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.867408 32685 raft_consensus.cc:729] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d360a60df72d4d9b929a50b388a3814d, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.867458 32685 consensus_queue.cc:260] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.867560 32685 ts_tablet_manager.cc:1428] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:21.867916 32717 tablet_replica.cc:330] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: stopping tablet replica
I20260808 14:40:21.868011 32717 raft_consensus.cc:2229] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:21.868104 32717 raft_consensus.cc:2258] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:21.868528 32717 ts_tablet_manager.cc:1905] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:21.870154 32717 ts_tablet_manager.cc:1918] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:21.870275 32717 log.cc:1196] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/52e54b841b4c4645a5228c771d57f7ff
I20260808 14:40:21.870406 32716 ts_tablet_manager.cc:1918] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:21.870479 32716 log.cc:1196] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/52e54b841b4c4645a5228c771d57f7ff
I20260808 14:40:21.870698 32717 ts_tablet_manager.cc:1939] T 52e54b841b4c4645a5228c771d57f7ff P 6c5ae67ff0ef4e4da0368596d975d7c0: Deleting consensus metadata
I20260808 14:40:21.870698 32716 ts_tablet_manager.cc:1939] T 52e54b841b4c4645a5228c771d57f7ff P 2a67ad3ac30f4fd8a7c442750b1f7098: Deleting consensus metadata
I20260808 14:40:21.871088 31928 catalog_manager.cc:4841] TS 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171): tablet 52e54b841b4c4645a5228c771d57f7ff (table test-table [id=3b75a62654c34db789bf0a564728f200]) successfully deleted
I20260808 14:40:21.871099 31927 catalog_manager.cc:4841] TS 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195:44609): tablet 52e54b841b4c4645a5228c771d57f7ff (table test-table [id=3b75a62654c34db789bf0a564728f200]) successfully deleted
I20260808 14:40:21.871722 32719 tablet_replica.cc:330] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: stopping tablet replica
I20260808 14:40:21.871824 32684 tablet_bootstrap.cc:492] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: No bootstrap required, opened a new log
I20260808 14:40:21.871871 32684 ts_tablet_manager.cc:1397] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260808 14:40:21.871946 32719 raft_consensus.cc:2229] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:21.872035 32719 raft_consensus.cc:2258] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:21.872005 32684 raft_consensus.cc:348] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.872066 32684 raft_consensus.cc:374] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.872088 32684 raft_consensus.cc:729] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a67ad3ac30f4fd8a7c442750b1f7098, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.872133 32684 consensus_queue.cc:260] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.872225 32684 ts_tablet_manager.cc:1428] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.872498 32719 ts_tablet_manager.cc:1905] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:21.873677 32719 ts_tablet_manager.cc:1918] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:21.873764 32719 log.cc:1196] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/52e54b841b4c4645a5228c771d57f7ff
I20260808 14:40:21.874027 32719 ts_tablet_manager.cc:1939] T 52e54b841b4c4645a5228c771d57f7ff P d360a60df72d4d9b929a50b388a3814d: Deleting consensus metadata
I20260808 14:40:21.874426 31931 catalog_manager.cc:4841] TS d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919): tablet 52e54b841b4c4645a5228c771d57f7ff (table test-table [id=3b75a62654c34db789bf0a564728f200]) successfully deleted
I20260808 14:40:21.876327 32691 raft_consensus.cc:482] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:21.876380 32691 raft_consensus.cc:504] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.876658 32691 leader_election.cc:288] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919), 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171)
I20260808 14:40:21.879999 32678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.876964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:56897 (local address 127.29.168.194:43171)
0808 14:40:21.877001 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.877003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.877122 (+ 119us) server_negotiation.cc:407] Connection header received
0808 14:40:21.877172 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.877173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.877180 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.877229 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.877376 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.877821 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.879122 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.879622 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.879728 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.879738 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.879886 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.879942 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:40:21.880029 32725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.876841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43171 (local address 127.29.168.195:56897)
0808 14:40:21.877046 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.877054 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.877117 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.877233 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.877233 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.877235 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.877300 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.877301 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.877902 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.877903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.879036 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.879038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.879735 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.879735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.879795 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.879798 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.879879 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.879935 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":31,"thread_start_us":51,"threads_started":1}
I20260808 14:40:21.880215 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015518b7361546e29486ff2f91168914" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" is_pre_election: true
I20260808 14:40:21.880275 32366 raft_consensus.cc:2454] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 0.
I20260808 14:40:21.880431 32465 leader_election.cc:302] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a67ad3ac30f4fd8a7c442750b1f7098, 6c5ae67ff0ef4e4da0368596d975d7c0; no voters:
I20260808 14:40:21.880571 32691 raft_consensus.cc:2781] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:21.880623 32691 raft_consensus.cc:482] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:21.880657 32691 raft_consensus.cc:3037] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.880693 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.876871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:33701 (local address 127.29.168.193:39919)
0808 14:40:21.876905 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.876906 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.876915 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:21.876936 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.876937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.876963 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.877009 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:21.877203 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.877910 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.879777 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.880304 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.880370 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.880377 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.880606 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.880638 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:40:21.880731 32478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.876794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:39919 (local address 127.29.168.195:33701)
0808 14:40:21.876841 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.876853 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.876895 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.877085 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.877086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.877087 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:21.877141 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.877142 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.877965 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.877966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.879036 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.879038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.880410 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.880411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.880491 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.880494 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.880540 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.880577 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":14}
I20260808 14:40:21.881036 32161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015518b7361546e29486ff2f91168914" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d360a60df72d4d9b929a50b388a3814d" is_pre_election: true
I20260808 14:40:21.881127 32161 raft_consensus.cc:2454] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 0.
I20260808 14:40:21.881397 32691 raft_consensus.cc:504] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.881515 32691 leader_election.cc:288] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 election: Requested vote from peers d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919), 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171)
I20260808 14:40:21.881625 32161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015518b7361546e29486ff2f91168914" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d360a60df72d4d9b929a50b388a3814d"
I20260808 14:40:21.881656 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015518b7361546e29486ff2f91168914" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098"
I20260808 14:40:21.881706 32161 raft_consensus.cc:3037] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.881716 32366 raft_consensus.cc:3037] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.882253 32366 raft_consensus.cc:2454] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 1.
I20260808 14:40:21.882413 32465 leader_election.cc:302] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a67ad3ac30f4fd8a7c442750b1f7098, 6c5ae67ff0ef4e4da0368596d975d7c0; no voters:
I20260808 14:40:21.882444 32161 raft_consensus.cc:2454] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 1.
I20260808 14:40:21.882508 32691 raft_consensus.cc:2781] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:21.882624 32691 raft_consensus.cc:686] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5ae67ff0ef4e4da0368596d975d7c0, State: Running, Role: LEADER
I20260808 14:40:21.882673 32691 consensus_queue.cc:237] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } }
I20260808 14:40:21.883270 31946 catalog_manager.cc:5495] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } health_report { overall_health: HEALTHY } } }
Aug 08 14:40:21 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:21.911791 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.904228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33151 (local address 127.0.0.1:44442)
0808 14:40:21.904394 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.904402 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.904472 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.904635 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.904636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.905037 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:21.905084 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.905087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.906012 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.906013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.906867 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.906871 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.907191 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.907192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.907253 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.907834 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:21.907838 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:21.909251 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:21.910668 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.910675 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.910677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.910880 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.911078 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:21.911079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:21.911079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:21.911135 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:21.911393 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:21.911401 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:21.911444 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.911531 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.911677 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260808 14:40:21.911804 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.904277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44442 (local address 127.29.168.254:33151)
0808 14:40:21.904333 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.904335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.904456 (+ 121us) server_negotiation.cc:407] Connection header received
0808 14:40:21.904526 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.904527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.904537 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.904615 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:21.905194 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.905937 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.906953 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.907121 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.907168 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.909330 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:21.909332 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:21.909332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:21.909339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:21.910576 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.910954 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.910955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.910955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.911013 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:21.911202 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:21.911202 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:21.911203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:21.911306 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:21.911401 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.911553 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.911728 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":30}
I20260808 14:40:21.914201 31946 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:44442:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:40:21.914467 31946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:21.915776 32336 tablet_service.cc:1467] Processing CreateTablet for tablet 979ebc278a09478bb989905886bae387 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6824f1cd6e13434698cde0f348f510a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:21.915853 32136 tablet_service.cc:1467] Processing CreateTablet for tablet 979ebc278a09478bb989905886bae387 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6824f1cd6e13434698cde0f348f510a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:21.915997 32136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 979ebc278a09478bb989905886bae387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.915997 32336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 979ebc278a09478bb989905886bae387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.917402 32684 tablet_bootstrap.cc:492] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: Bootstrap starting.
I20260808 14:40:21.917785 32684 tablet_bootstrap.cc:654] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.918310 32547 tablet_service.cc:1467] Processing CreateTablet for tablet 979ebc278a09478bb989905886bae387 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6824f1cd6e13434698cde0f348f510a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:21.918409 32547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 979ebc278a09478bb989905886bae387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:21.919313 32683 tablet_bootstrap.cc:492] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: Bootstrap starting.
I20260808 14:40:21.919550 32684 tablet_bootstrap.cc:492] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: No bootstrap required, opened a new log
I20260808 14:40:21.919549 32685 tablet_bootstrap.cc:492] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: Bootstrap starting.
I20260808 14:40:21.919595 32684 ts_tablet_manager.cc:1397] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:21.919719 32683 tablet_bootstrap.cc:654] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.919770 32684 raft_consensus.cc:348] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.919847 32684 raft_consensus.cc:374] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.919871 32684 raft_consensus.cc:729] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a67ad3ac30f4fd8a7c442750b1f7098, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.919925 32685 tablet_bootstrap.cc:654] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:21.919916 32684 consensus_queue.cc:260] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.920009 32684 ts_tablet_manager.cc:1428] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.920270 32690 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.920392 32690 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.920841 32685 tablet_bootstrap.cc:492] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: No bootstrap required, opened a new log
I20260808 14:40:21.920881 32683 tablet_bootstrap.cc:492] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: No bootstrap required, opened a new log
I20260808 14:40:21.920887 32685 ts_tablet_manager.cc:1397] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:21.920920 32683 ts_tablet_manager.cc:1397] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:40:21.921028 32685 raft_consensus.cc:348] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.921069 32685 raft_consensus.cc:374] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.921082 32685 raft_consensus.cc:729] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d360a60df72d4d9b929a50b388a3814d, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.921135 32685 consensus_queue.cc:260] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.921185 32683 raft_consensus.cc:348] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.921221 32685 ts_tablet_manager.cc:1428] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.921239 32683 raft_consensus.cc:374] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:21.921258 32683 raft_consensus.cc:729] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5ae67ff0ef4e4da0368596d975d7c0, State: Initialized, Role: FOLLOWER
I20260808 14:40:21.921258 32708 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.921298 32683 consensus_queue.cc:260] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.921360 32708 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.921391 32683 ts_tablet_manager.cc:1428] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:21.921546 32691 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.921628 32691 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.960577 32691 raft_consensus.cc:482] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:21.960681 32691 raft_consensus.cc:504] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.960876 32691 leader_election.cc:288] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171), d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919)
I20260808 14:40:21.961061 32161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979ebc278a09478bb989905886bae387" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d360a60df72d4d9b929a50b388a3814d" is_pre_election: true
I20260808 14:40:21.961050 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979ebc278a09478bb989905886bae387" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" is_pre_election: true
I20260808 14:40:21.961139 32161 raft_consensus.cc:2454] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 0.
I20260808 14:40:21.961139 32366 raft_consensus.cc:2454] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 0.
I20260808 14:40:21.961293 32469 leader_election.cc:302] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5ae67ff0ef4e4da0368596d975d7c0, d360a60df72d4d9b929a50b388a3814d; no voters:
I20260808 14:40:21.961422 32691 raft_consensus.cc:2781] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:21.961459 32691 raft_consensus.cc:482] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:21.961472 32691 raft_consensus.cc:3037] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.962147 32691 raft_consensus.cc:504] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.962273 32691 leader_election.cc:288] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171), d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919)
I20260808 14:40:21.962442 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979ebc278a09478bb989905886bae387" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098"
I20260808 14:40:21.962495 32161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979ebc278a09478bb989905886bae387" candidate_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d360a60df72d4d9b929a50b388a3814d"
I20260808 14:40:21.962527 32366 raft_consensus.cc:3037] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.962551 32161 raft_consensus.cc:3037] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:21.963075 32161 raft_consensus.cc:2454] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 1.
I20260808 14:40:21.963258 32469 leader_election.cc:302] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5ae67ff0ef4e4da0368596d975d7c0, d360a60df72d4d9b929a50b388a3814d; no voters:
I20260808 14:40:21.963349 32691 raft_consensus.cc:2781] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:21.963343 32366 raft_consensus.cc:2454] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5ae67ff0ef4e4da0368596d975d7c0 in term 1.
I20260808 14:40:21.963395 32691 raft_consensus.cc:686] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5ae67ff0ef4e4da0368596d975d7c0, State: Running, Role: LEADER
I20260808 14:40:21.963444 32691 consensus_queue.cc:237] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } }
I20260808 14:40:21.963749 32728 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: TxnStatusTablet state changed. Reason: New leader 6c5ae67ff0ef4e4da0368596d975d7c0. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.963827 32728 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:21.964088 32751 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:40:21.964082 31946 catalog_manager.cc:5495] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:21.964202 32751 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260808 14:40:21.964515 32228 tablet.cc:2369] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:21.970643 32679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.967561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40956 (local address 127.29.168.195:44609)
0808 14:40:21.967609 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.967611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.967622 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:21.967724 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.967725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.967755 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.967837 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:21.967991 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.968707 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.969727 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.970001 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.970069 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.970286 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:21.970419 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:21.970484 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.970556 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.970576 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:40:21.970680 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.967428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44609 (local address 127.0.0.1:40956)
0808 14:40:21.967554 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.967565 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.967609 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.967861 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.967862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.967863 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:21.967915 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.967917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.968807 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.968808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.969635 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.969637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.970080 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.970081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.970150 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.970167 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:21.970483 (+ 316us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:21.970492 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.970551 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.970601 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 14:40:21.971866 32366 raft_consensus.cc:1261] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Refusing update from remote peer 6c5ae67ff0ef4e4da0368596d975d7c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:21.971894 32161 raft_consensus.cc:1261] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Refusing update from remote peer 6c5ae67ff0ef4e4da0368596d975d7c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:21.972096 32728 consensus_queue.cc:1035] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:21.972191 32691 consensus_queue.cc:1035] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:21.972851 32690 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: TxnStatusTablet state changed. Reason: New leader 6c5ae67ff0ef4e4da0368596d975d7c0. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.972872 32708 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: TxnStatusTablet state changed. Reason: New leader 6c5ae67ff0ef4e4da0368596d975d7c0. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.972941 32690 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.972946 32708 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.974164 32691 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.974251 32691 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:21.974325 32701 mvcc.cc:205] Tried to move back new op lower bound from 7316275289994895360 to 7316275289962635264. Current Snapshot: MvccSnapshot[applied={T|T < 7316275289994895360}]
I20260808 14:40:21.974862 32690 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.974939 32690 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 2a67ad3ac30f4fd8a7c442750b1f7098: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.975410 32728 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.975483 32728 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P 6c5ae67ff0ef4e4da0368596d975d7c0: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:21.975860 32708 tablet_replica.cc:439] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 } } peers { permanent_uuid: "6c5ae67ff0ef4e4da0368596d975d7c0" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44609 } } peers { permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 } } }
I20260808 14:40:21.975941 32708 tablet_replica.cc:442] T 979ebc278a09478bb989905886bae387 P d360a60df72d4d9b929a50b388a3814d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:21.980592 32679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.977711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.29.168.195:44609)
0808 14:40:21.977862 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.977863 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.977870 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:21.977888 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.977889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.977899 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.977958 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:21.978103 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.978744 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.979837 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.980110 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.980162 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.980313 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:21.980341 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:21.980380 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.980517 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.980532 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 14:40:21.985841 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.983043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44609 (local address 127.29.168.195:50845)
0808 14:40:21.983106 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:21.983114 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:21.983145 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:21.983418 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:21.983418 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:21.983419 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:21.983466 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.983467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.984271 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.984272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.985068 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:21.985070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.985462 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.985463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:21.985511 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.985545 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:21.985696 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:21.985697 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:40:21.985731 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 14:40:21.985763 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:40:21.986052 32679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:21.983276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:50845 (local address 127.29.168.195:44609)
0808 14:40:21.983319 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:21.983321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:21.983327 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:21.983343 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:21.983344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:21.983351 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:21.983391 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:21.983517 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.984197 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.985147 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:21.985393 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:21.985440 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:21.985617 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:21.985644 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:21.985680 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:21.985989 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:40:21.986002 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:40:21.988638 32161 raft_consensus.cc:1261] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Refusing update from remote peer 6c5ae67ff0ef4e4da0368596d975d7c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:21.988664 32366 raft_consensus.cc:1261] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Refusing update from remote peer 6c5ae67ff0ef4e4da0368596d975d7c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:21.988910 32728 consensus_queue.cc:1035] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d360a60df72d4d9b929a50b388a3814d" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 39919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:21.989015 32728 consensus_queue.cc:1035] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a67ad3ac30f4fd8a7c442750b1f7098" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:22.000262 31946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:22.000341 31946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:22.000877 31946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c85cd1b3c27042038789eb5e4cd94687: Sending DeleteTablet for 3 replicas of tablet 015518b7361546e29486ff2f91168914
I20260808 14:40:22.001116 32336 tablet_service.cc:1514] Processing DeleteTablet for tablet 015518b7361546e29486ff2f91168914 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:21 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:38524
I20260808 14:40:22.001138 32549 tablet_service.cc:1514] Processing DeleteTablet for tablet 015518b7361546e29486ff2f91168914 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:21 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:40946
I20260808 14:40:22.001196 32716 tablet_replica.cc:330] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: stopping tablet replica
I20260808 14:40:22.001221 32717 tablet_replica.cc:330] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: stopping tablet replica
I20260808 14:40:22.001236 32716 raft_consensus.cc:2229] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:22.001271 32717 raft_consensus.cc:2229] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:22.001266 32716 raft_consensus.cc:2258] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:22.001369 32717 raft_consensus.cc:2258] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:22.001731 32716 ts_tablet_manager.cc:1905] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:22.001756 32717 ts_tablet_manager.cc:1905] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:22.003105 32717 ts_tablet_manager.cc:1918] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:22.003229 32717 log.cc:1196] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/015518b7361546e29486ff2f91168914
I20260808 14:40:22.003306 32716 ts_tablet_manager.cc:1918] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:22.003368 32716 log.cc:1196] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/015518b7361546e29486ff2f91168914
I20260808 14:40:22.003491 32717 ts_tablet_manager.cc:1939] T 015518b7361546e29486ff2f91168914 P 6c5ae67ff0ef4e4da0368596d975d7c0: Deleting consensus metadata
I20260808 14:40:22.003592 32716 ts_tablet_manager.cc:1939] T 015518b7361546e29486ff2f91168914 P 2a67ad3ac30f4fd8a7c442750b1f7098: Deleting consensus metadata
I20260808 14:40:22.003794 31927 catalog_manager.cc:4841] TS 6c5ae67ff0ef4e4da0368596d975d7c0 (127.29.168.195:44609): tablet 015518b7361546e29486ff2f91168914 (table test-table [id=79daa342aedf4b9fbf56cdd960b155cd]) successfully deleted
I20260808 14:40:22.003903 31928 catalog_manager.cc:4841] TS 2a67ad3ac30f4fd8a7c442750b1f7098 (127.29.168.194:43171): tablet 015518b7361546e29486ff2f91168914 (table test-table [id=79daa342aedf4b9fbf56cdd960b155cd]) successfully deleted
I20260808 14:40:22.004143 32136 tablet_service.cc:1514] Processing DeleteTablet for tablet 015518b7361546e29486ff2f91168914 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:21 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:50334
I20260808 14:40:22.004261 32719 tablet_replica.cc:330] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: stopping tablet replica
I20260808 14:40:22.004321 32719 raft_consensus.cc:2229] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:22.004367 32719 raft_consensus.cc:2258] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:22.004724 32719 ts_tablet_manager.cc:1905] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:22.006021 32719 ts_tablet_manager.cc:1918] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:22.006098 32719 log.cc:1196] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/015518b7361546e29486ff2f91168914
I20260808 14:40:22.006304 32719 ts_tablet_manager.cc:1939] T 015518b7361546e29486ff2f91168914 P d360a60df72d4d9b929a50b388a3814d: Deleting consensus metadata
I20260808 14:40:22.006664 31931 catalog_manager.cc:4841] TS d360a60df72d4d9b929a50b388a3814d (127.29.168.193:39919): tablet 015518b7361546e29486ff2f91168914 (table test-table [id=79daa342aedf4b9fbf56cdd960b155cd]) successfully deleted
Aug 08 14:40:22 dist-test-slave-mjjr krb5kdc[31887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:22.013198 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:22.003058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50358 (local address 127.29.168.193:39919)
0808 14:40:22.003724 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:22.003726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:22.003998 (+ 272us) server_negotiation.cc:407] Connection header received
0808 14:40:22.004054 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:22.004055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:22.004065 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:22.004118 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:22.005101 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:22.005881 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:22.007004 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:22.007310 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:22.007383 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:22.010300 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:22.010309 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:22.010309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:22.010317 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:22.012128 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:22.012492 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:22.012495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:22.012496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:22.012571 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:22.012725 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:22.012725 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:22.012726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:22.012874 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:22.012997 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:22.013028 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 14:40:22.013101 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638}
W20260808 14:40:22.013433 32197 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50358
I20260808 14:40:22.020283 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:22.014323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44448 (local address 127.29.168.254:33151)
0808 14:40:22.014359 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:22.014361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:22.014399 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:40:22.014494 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:22.014495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:22.014505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:22.014560 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:22.015002 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:22.015744 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:22.016358 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:22.016643 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:22.016705 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:22.017679 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:22.017681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:22.017681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:22.017687 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:22.019105 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:22.019387 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:22.019388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:22.019388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:22.019443 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:22.019828 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:22.019829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:22.019830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:22.019948 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:22.020038 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:22.020128 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 14:40:22.020201 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:40:22.020627 31946 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44448
I20260808 14:40:22.021265 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 32044
I20260808 14:40:22.033156 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 32244
I20260808 14:40:22.044596 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 32446
I20260808 14:40:22.051996 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31903
2026-08-08T14:40:22Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2162 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:22 dist-test-slave-mjjr krb5kdc[313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:22 dist-test-slave-mjjr krb5kdc[313](info): set up 2 sockets
Aug 08 14:40:22 dist-test-slave-mjjr krb5kdc[313](info): commencing operation
krb5kdc: starting...
W20260808 14:40:23.226172 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:23.338313 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33553
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:23.416219 332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:23.416437 332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:23.416472 332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:23.417536 332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:23.417598 332 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:40:23.417618 332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:23.417636 332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:23.417665 332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:23.417686 332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:23.419047 332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33553
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:23.419329 332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:23.419535 332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:23.424026 338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:23.424018 340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:23.424175 342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:23.424347 332 server_base.cc:1034] running on GCE node
I20260808 14:40:23.424554 332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:23.424844 332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:23.426002 332 hybrid_clock.cc:648] HybridClock initialized: now 1786200023425995 us; error 41 us; skew 500 ppm
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:23.428344 332 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:23.428745 332 webserver.cc:460] Webserver started at http://127.29.168.254:43965/ using document root <none> and password file <none>
I20260808 14:40:23.428920 332 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:23.428958 332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:23.429036 332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:23.429884 332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "34266c9a0de541e991bf8df87ecbba15"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "1fd89e8d0619741bea9e533e05674ddd"
server_key_iv: "78d94e48b969b8c64153deb10ee6e631"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.430150 332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "34266c9a0de541e991bf8df87ecbba15"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "1fd89e8d0619741bea9e533e05674ddd"
server_key_iv: "78d94e48b969b8c64153deb10ee6e631"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.431354 332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:23.432142 353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.432343 332 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:23.432430 332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "34266c9a0de541e991bf8df87ecbba15"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "1fd89e8d0619741bea9e533e05674ddd"
server_key_iv: "78d94e48b969b8c64153deb10ee6e631"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.432514 332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:23.460902 332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:23.462646 332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:23.462806 332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:23.467438 332 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33553
I20260808 14:40:23.467514 451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33553 every 8 connection(s)
I20260808 14:40:23.467872 332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:23.468554 452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:23.470690 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Bootstrap starting.
I20260808 14:40:23.471248 452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:23.471544 452 log.cc:824] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:23.472246 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: No bootstrap required, opened a new log
I20260808 14:40:23.472704 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 332
I20260808 14:40:23.472808 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:23.472981 30371 external_mini_cluster.cc:1428] Setting key 35f2b4a72c335e31c0b479142f4d67f7
I20260808 14:40:23.474815 452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34266c9a0de541e991bf8df87ecbba15" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33553 } }
I20260808 14:40:23.474987 452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:23.475023 452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34266c9a0de541e991bf8df87ecbba15, State: Initialized, Role: FOLLOWER
I20260808 14:40:23.475152 452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34266c9a0de541e991bf8df87ecbba15" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33553 } }
I20260808 14:40:23.475244 452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:23.475272 452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:23.475309 452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:23.475956 452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34266c9a0de541e991bf8df87ecbba15" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33553 } }
I20260808 14:40:23.476105 452 leader_election.cc:302] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34266c9a0de541e991bf8df87ecbba15; no voters:
I20260808 14:40:23.476284 452 leader_election.cc:288] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:23.476315 461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:23.476475 461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [term 1 LEADER]: Becoming Leader. State: Replica: 34266c9a0de541e991bf8df87ecbba15, State: Running, Role: LEADER
I20260808 14:40:23.476579 452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:23.476604 461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34266c9a0de541e991bf8df87ecbba15" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33553 } }
I20260808 14:40:23.477031 461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34266c9a0de541e991bf8df87ecbba15. Latest consensus state: current_term: 1 leader_uuid: "34266c9a0de541e991bf8df87ecbba15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34266c9a0de541e991bf8df87ecbba15" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33553 } } }
I20260808 14:40:23.477038 462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34266c9a0de541e991bf8df87ecbba15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34266c9a0de541e991bf8df87ecbba15" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33553 } } }
I20260808 14:40:23.477258 462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:23.477411 461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:23.477476 472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:23.478024 472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:23.479673 472 catalog_manager.cc:1347] Generated new cluster ID: abb4dee9b1a1434aa6c254ac8b321b10
I20260808 14:40:23.479723 472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:23.485056 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.473502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54166 (local address 127.29.168.254:33553)
0808 14:40:23.473685 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.473692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.473717 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:40:23.474797 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.474803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.474846 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.474960 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.475726 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.476873 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.477868 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.478395 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.478520 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.481197 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.481201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.481201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.481211 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.483294 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.483812 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.483816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.483816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.483934 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.484162 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.484163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.484163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.484468 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.484631 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.484723 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.484864 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260808 14:40:23.503849 472 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:23.504510 472 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:23.512364 472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Generated new TSK 0
I20260808 14:40:23.512535 472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:23.542128 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33553
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:23.620625 490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:23.620793 490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:23.620815 490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:23.621820 490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:23.621860 490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:23.621881 490 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:40:23.621892 490 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:23.621908 490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:23.623252 490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:33553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:23.623413 490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:23.623572 490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:23.628305 501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:23.628321 504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:23.628311 502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:23.628526 490 server_base.cc:1034] running on GCE node
I20260808 14:40:23.628715 490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:23.628907 490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:23.630038 490 hybrid_clock.cc:648] HybridClock initialized: now 1786200023630017 us; error 41 us; skew 500 ppm
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:23.632436 490 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:23.632818 490 webserver.cc:460] Webserver started at http://127.29.168.193:40509/ using document root <none> and password file <none>
I20260808 14:40:23.633011 490 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:23.633051 490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:23.633164 490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:23.634048 490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "05ac7fd723684a0f97d32643ec0707c7"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "1c3fa4ae643728d4560eeb3a945df286"
server_key_iv: "dca583cbc28e9ced4acc7ccf3f867673"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.634325 490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "05ac7fd723684a0f97d32643ec0707c7"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "1c3fa4ae643728d4560eeb3a945df286"
server_key_iv: "dca583cbc28e9ced4acc7ccf3f867673"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.635722 490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:23.636451 515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.636627 490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:23.636714 490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "05ac7fd723684a0f97d32643ec0707c7"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "1c3fa4ae643728d4560eeb3a945df286"
server_key_iv: "dca583cbc28e9ced4acc7ccf3f867673"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.636797 490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:23.646715 490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:23.648514 490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:23.648669 490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:23.649109 490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:23.649145 490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.649166 490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:23.649217 490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:23.657006 490 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38029
I20260808 14:40:23.657403 490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:23.657423 686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38029 every 8 connection(s)
I20260808 14:40:23.659622 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.649615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:56947 (local address 127.29.168.254:33553)
0808 14:40:23.649686 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.649689 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.649934 (+ 245us) server_negotiation.cc:407] Connection header received
0808 14:40:23.650646 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.650647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.650662 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.650718 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.651601 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.652453 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.653431 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.653771 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.653849 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.656576 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.656578 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.656578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.656586 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.658202 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.658653 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.658655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.658655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.658716 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.658969 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.658970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.658971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.659088 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.659162 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.659437 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.659533 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:40:23.659780 526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.649587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.29.168.193:56947)
0808 14:40:23.649781 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.649826 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.650520 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.650791 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.650794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.651178 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:23.651470 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.651477 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.652538 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.652539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.653306 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.653309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.653871 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.653872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.653983 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.654480 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:23.654487 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:23.656491 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:23.658310 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.658318 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.658320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.658564 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.658787 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.658788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.658788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.658895 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.659153 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:23.659161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:23.659289 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.659393 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.659543 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":104,"threads_started":1}
I20260808 14:40:23.660285 687 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33553
I20260808 14:40:23.660391 687 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:23.660646 687 heartbeater.cc:511] Master 127.29.168.254:33553 requested a full tablet report, sending...
I20260808 14:40:23.661441 379 ts_manager.cc:194] Registered new tserver with Master: 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029)
I20260808 14:40:23.662075 379 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:56947
I20260808 14:40:23.666749 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 490
I20260808 14:40:23.666873 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:23.667092 30371 external_mini_cluster.cc:1428] Setting key 36158e844e1d02fe7c24c110be77d8ac
I20260808 14:40:23.667825 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.661261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:52887 (local address 127.29.168.254:33553)
0808 14:40:23.661312 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.661314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.662501 (+ 1187us) server_negotiation.cc:407] Connection header received
0808 14:40:23.662555 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.662556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.662566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.662630 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.662943 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.663377 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.664141 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.664308 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.664366 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.665151 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.665153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.665153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.665159 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.666516 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.666971 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.666972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.666972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.667030 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.667253 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.667253 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.667254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.667406 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.667485 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.667635 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.667726 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:40:23.667892 699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.662282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.29.168.193:52887)
0808 14:40:23.662429 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.662441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.662510 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.662634 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.662635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.662820 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:23.662871 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.662872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.663476 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.663477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.664068 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.664071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.664384 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.664385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.664445 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.664778 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:23.664782 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:23.665075 (+ 293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:23.666612 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.666613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.666614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.666868 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.667102 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.667103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.667104 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.667181 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.667478 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:23.667479 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:23.667527 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.667599 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.667791 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:23.691363 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33553
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:23.770100 702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:23.770298 702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:23.770324 702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:23.771392 702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:23.771457 702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:23.771504 702 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:40:23.771552 702 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:23.771601 702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:23.773156 702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:33553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:23.773381 702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:23.773599 702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:23.778597 712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:23.778774 702 server_base.cc:1034] running on GCE node
W20260808 14:40:23.778638 709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:23.778604 708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:23.779018 702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:23.779198 702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:23.780323 702 hybrid_clock.cc:648] HybridClock initialized: now 1786200023780312 us; error 27 us; skew 500 ppm
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:23.782677 702 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:23.783041 702 webserver.cc:460] Webserver started at http://127.29.168.194:44575/ using document root <none> and password file <none>
I20260808 14:40:23.783243 702 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:23.783317 702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:23.783453 702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:23.784372 702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "131d9814935e4eafb78671ee1cdccd63"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "a284efe0cc267c40c662d8796192cabc"
server_key_iv: "2e288a745ebc05c0425c85535cd7dc0b"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.784673 702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "131d9814935e4eafb78671ee1cdccd63"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "a284efe0cc267c40c662d8796192cabc"
server_key_iv: "2e288a745ebc05c0425c85535cd7dc0b"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.785866 702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:23.786545 726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.786721 702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:23.786815 702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "131d9814935e4eafb78671ee1cdccd63"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "a284efe0cc267c40c662d8796192cabc"
server_key_iv: "2e288a745ebc05c0425c85535cd7dc0b"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.786898 702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:23.795502 702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:23.797173 702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:23.797317 702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:23.797760 702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:23.797821 702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.797897 702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:23.797925 702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:23.804917 702 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:33115
I20260808 14:40:23.804996 882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:33115 every 8 connection(s)
I20260808 14:40:23.805294 702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:23.806087 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 702
I20260808 14:40:23.806182 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:23.806357 30371 external_mini_cluster.cc:1428] Setting key 88aec5cae60c566aec48f2534bb8e096
I20260808 14:40:23.807998 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.798359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:56671 (local address 127.29.168.254:33553)
0808 14:40:23.798417 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.798419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.798611 (+ 192us) server_negotiation.cc:407] Connection header received
0808 14:40:23.799023 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.799024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.799040 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.799108 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.799951 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.800701 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.802235 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.802587 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.802668 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.804826 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.804827 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.804828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.804836 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.806556 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.807020 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.807021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.807021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.807086 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.807386 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.807387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.807387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.807486 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.807537 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.807873 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.807936 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:40:23.808290 735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.798363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.29.168.194:56671)
0808 14:40:23.798512 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.798541 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.798934 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.799181 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.799185 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.799494 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:23.799849 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.799855 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.800807 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.800822 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.802123 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.802126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.802704 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.802705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.802822 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.803295 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:23.803302 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:23.804704 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:23.806637 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.806657 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.806659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.806946 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.807158 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.807158 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.807159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.807316 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.807549 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:23.807557 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:23.807732 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.807851 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.808021 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":94,"threads_started":1}
I20260808 14:40:23.808820 884 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33553
I20260808 14:40:23.808929 884 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:23.809124 884 heartbeater.cc:511] Master 127.29.168.254:33553 requested a full tablet report, sending...
I20260808 14:40:23.809500 379 ts_manager.cc:194] Registered new tserver with Master: 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115)
I20260808 14:40:23.810014 379 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:56671
I20260808 14:40:23.816527 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.809871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:50541 (local address 127.29.168.254:33553)
0808 14:40:23.809912 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.809914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.810841 (+ 927us) server_negotiation.cc:407] Connection header received
0808 14:40:23.810899 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.810899 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.810907 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.810947 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.811281 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.811778 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.812849 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.813016 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.813064 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.814033 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.814034 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.814034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.814040 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.815415 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.815817 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.815818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.815818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.815866 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.816062 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.816063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.816063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.816203 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.816249 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.816423 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.816474 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:23.816624 894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.809829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.29.168.194:50541)
0808 14:40:23.810758 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.810769 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.810852 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.810953 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.810954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.811159 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:23.811215 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.811216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.811877 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.811878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.812757 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.812760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.813090 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.813091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.813176 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.813533 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:23.813539 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:23.813953 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:23.815495 (+ 1542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.815496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.815496 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.815750 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.815932 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.815933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.815933 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.815999 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.816271 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:23.816272 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:23.816322 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.816409 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.816509 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:23.831907 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33553
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:23.913331 897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:23.913525 897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:23.913549 897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:23.914655 897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:23.914695 897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:23.914712 897 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:40:23.914723 897 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:23.914772 897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:23.916186 897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:33553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:23.916417 897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:23.916657 897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:23.921458 905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:23.921515 897 server_base.cc:1034] running on GCE node
W20260808 14:40:23.921499 906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:23.921478 908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:23.921811 897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:23.922086 897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:23.923220 897 hybrid_clock.cc:648] HybridClock initialized: now 1786200023923207 us; error 29 us; skew 500 ppm
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:23.925654 897 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:23.926165 897 webserver.cc:460] Webserver started at http://127.29.168.195:41287/ using document root <none> and password file <none>
I20260808 14:40:23.926395 897 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:23.926460 897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:23.926637 897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:23.927610 897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "3f833743d35040d1b0ecef1a52bd9a00"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "654253038d48df9e25f023cd7d3bc83c"
server_key_iv: "7e8d3ae9e5456ae72e2bae467ba7c066"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.928026 897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "3f833743d35040d1b0ecef1a52bd9a00"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "654253038d48df9e25f023cd7d3bc83c"
server_key_iv: "7e8d3ae9e5456ae72e2bae467ba7c066"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.929335 897 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:23.930083 916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.930258 897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:23.930356 897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "3f833743d35040d1b0ecef1a52bd9a00"
format_stamp: "Formatted at 2026-08-08 14:40:23 on dist-test-slave-mjjr"
server_key: "654253038d48df9e25f023cd7d3bc83c"
server_key_iv: "7e8d3ae9e5456ae72e2bae467ba7c066"
server_key_version: "encryptionkey@0"
I20260808 14:40:23.930430 897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:23.943965 897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:23.945647 897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:23.945797 897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:23.946314 897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:23.946393 897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:23.946424 897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:23.946452 897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:23.954262 897 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:44097
I20260808 14:40:23.954648 897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:23.954659 1100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:44097 every 8 connection(s)
I20260808 14:40:23.955214 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.946728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:57427 (local address 127.29.168.254:33553)
0808 14:40:23.946793 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.946795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.947049 (+ 254us) server_negotiation.cc:407] Connection header received
0808 14:40:23.947500 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.947502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.947515 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.947576 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.948195 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.948704 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.949679 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.949861 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.949931 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.952368 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.952369 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.952370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.952378 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.953822 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.954263 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.954264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.954264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.954325 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.954590 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.954591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.954592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.954693 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.954774 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.955083 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.955154 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:40:23.955394 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.946730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.29.168.195:57427)
0808 14:40:23.946910 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.946942 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.947397 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.947635 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.947672 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.947939 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:23.948100 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.948104 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.948804 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.948805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.949592 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.949594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.949938 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.949939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.950085 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.950590 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:23.950601 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:23.952269 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:23.953916 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.953923 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.953925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.954185 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.954407 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.954409 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.954409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.954523 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.954802 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:23.954808 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:23.954948 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.955054 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.955181 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260808 14:40:23.955824 1101 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33553
I20260808 14:40:23.955904 1101 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:23.956063 1101 heartbeater.cc:511] Master 127.29.168.254:33553 requested a full tablet report, sending...
I20260808 14:40:23.956346 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 897
I20260808 14:40:23.956444 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:23.956647 30371 external_mini_cluster.cc:1428] Setting key 4f687929a762f5b40fda09e75711e216
I20260808 14:40:23.956660 377 ts_manager.cc:194] Registered new tserver with Master: 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:23.957110 377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:57427
I20260808 14:40:23.957496 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:40:23.963541 1111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.957467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.29.168.195:38201)
0808 14:40:23.957620 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.957630 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.957689 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.957815 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.957815 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.958009 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:23.958052 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.958053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.958907 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.958908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.959372 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.959373 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.959870 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.959871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.959954 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.960274 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:23.960279 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:23.960660 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:23.962495 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.962496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.962496 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.962663 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.962897 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:23.962897 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:23.962898 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:23.963009 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:23.963301 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:23.963302 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:23.963346 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.963395 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.963482 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260808 14:40:23.963624 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.957459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:38201 (local address 127.29.168.254:33553)
0808 14:40:23.957500 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.957501 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.957699 (+ 198us) server_negotiation.cc:407] Connection header received
0808 14:40:23.957741 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.957741 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.957751 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.957804 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.958129 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.958811 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.959444 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.959780 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.959843 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.960751 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.960752 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.960752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.960760 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.962389 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.962762 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.962763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.962763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.962831 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.963094 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.963095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.963095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.963227 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.963306 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.963453 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.963530 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:40:23 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:23.981817 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.975196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54170 (local address 127.29.168.254:33553)
0808 14:40:23.975245 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.975247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.975275 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:40:23.975326 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.975326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.975334 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.975384 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:23.975917 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.976470 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.977259 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.977439 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.977522 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.979899 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:23.979900 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:23.979900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:23.979906 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:23.980959 (+ 1053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.981251 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.981251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.981252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.981297 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:23.981440 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:23.981441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:23.981441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:23.981538 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:23.981602 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.981687 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.981739 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:40:23.983367 379 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:23.985092 379 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:23.991104 1119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.987077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44097 (local address 127.0.0.1:41162)
0808 14:40:23.987317 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.987359 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.987468 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.987787 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.987790 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.987791 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:23.987870 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.987872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.988744 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.988745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.989817 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.989819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.990800 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.990801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.990904 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.990916 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.990984 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.991031 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":3,"thread_start_us":58,"threads_started":1}
I20260808 14:40:23.991147 1123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.987140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41162 (local address 127.29.168.195:44097)
0808 14:40:23.987290 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.987296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.987424 (+ 128us) server_negotiation.cc:407] Connection header received
0808 14:40:23.987573 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.987576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.987592 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.987644 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:23.987925 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.988661 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.989922 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.990645 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.990691 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.990741 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.991015 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.991057 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260808 14:40:23.991639 1121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.987112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:33115 (local address 127.0.0.1:39152)
0808 14:40:23.987409 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.987418 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.987500 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.988096 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.988097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.988099 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:23.988143 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.988144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.989283 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.989284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.990347 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.990349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.991398 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.991399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.991470 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.991474 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.991508 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.991546 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":46,"threads_started":1}
I20260808 14:40:23.991871 1127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.987551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.29.168.193:38029)
0808 14:40:23.987745 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.987749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.987759 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:23.987797 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.987799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.987813 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.987892 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:23.988081 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.989147 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.990489 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.991249 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.991342 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.991402 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.991680 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.991728 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":132,"threads_started":1}
I20260808 14:40:23.992048 1126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.987336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38029 (local address 127.0.0.1:51268)
0808 14:40:23.987534 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:23.987543 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:23.987584 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:23.987953 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:23.987954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:23.987956 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:23.988003 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.988005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.989237 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.989238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.990394 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:23.990396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.991476 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.991496 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:23.991558 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.991562 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:23.991626 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:40:23.991695 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":47,"thread_start_us":53,"threads_started":1}
I20260808 14:40:23.991971 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 5cb42ab61f274cafae2b436104a02e58 (DEFAULT_TABLE table=test-table [id=14bf4fe32d5942d5a333148128c2d109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:23.992121 1124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:23.987220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39152 (local address 127.29.168.194:33115)
0808 14:40:23.987382 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:23.987386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:23.987837 (+ 451us) server_negotiation.cc:407] Connection header received
0808 14:40:23.987999 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:23.988004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:23.988024 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:23.988099 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:23.988203 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.989221 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.990441 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:23.991193 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:23.991855 (+ 662us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:23.991925 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:23.991954 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 14:40:23.992015 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260808 14:40:23.992348 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cb42ab61f274cafae2b436104a02e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:23.992659 786 tablet_service.cc:1467] Processing CreateTablet for tablet 5cb42ab61f274cafae2b436104a02e58 (DEFAULT_TABLE table=test-table [id=14bf4fe32d5942d5a333148128c2d109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:23.992910 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cb42ab61f274cafae2b436104a02e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:23.994879 1132 tablet_bootstrap.cc:492] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Bootstrap starting.
I20260808 14:40:23.995606 1134 tablet_bootstrap.cc:492] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Bootstrap starting.
I20260808 14:40:23.995868 1132 tablet_bootstrap.cc:654] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:23.996236 1134 tablet_bootstrap.cc:654] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:23.996223 1132 log.cc:824] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:23.996367 584 tablet_service.cc:1467] Processing CreateTablet for tablet 5cb42ab61f274cafae2b436104a02e58 (DEFAULT_TABLE table=test-table [id=14bf4fe32d5942d5a333148128c2d109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:23.996584 1134 log.cc:824] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:23.996716 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cb42ab61f274cafae2b436104a02e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:23.996968 1132 tablet_bootstrap.cc:492] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: No bootstrap required, opened a new log
I20260808 14:40:23.997018 1132 ts_tablet_manager.cc:1397] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:40:23.998220 1132 raft_consensus.cc:348] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:23.998337 1132 raft_consensus.cc:374] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:23.998358 1132 raft_consensus.cc:729] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f833743d35040d1b0ecef1a52bd9a00, State: Initialized, Role: FOLLOWER
I20260808 14:40:23.998471 1132 consensus_queue.cc:260] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:23.998764 1132 ts_tablet_manager.cc:1428] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:40:23.998843 1101 heartbeater.cc:503] Master 127.29.168.254:33553 was elected leader, sending a full tablet report...
I20260808 14:40:23.999348 1134 tablet_bootstrap.cc:492] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: No bootstrap required, opened a new log
I20260808 14:40:23.999421 1134 ts_tablet_manager.cc:1397] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 14:40:23.999572 1138 tablet_bootstrap.cc:492] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Bootstrap starting.
I20260808 14:40:24.000165 1138 tablet_bootstrap.cc:654] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.000429 1138 log.cc:824] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:24.001008 1138 tablet_bootstrap.cc:492] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: No bootstrap required, opened a new log
I20260808 14:40:24.001055 1138 ts_tablet_manager.cc:1397] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:24.001135 1134 raft_consensus.cc:348] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.001286 1134 raft_consensus.cc:374] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.001327 1134 raft_consensus.cc:729] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131d9814935e4eafb78671ee1cdccd63, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.001430 1134 consensus_queue.cc:260] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.001719 1134 ts_tablet_manager.cc:1428] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:40:24.001775 884 heartbeater.cc:503] Master 127.29.168.254:33553 was elected leader, sending a full tablet report...
I20260808 14:40:24.002926 1138 raft_consensus.cc:348] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.003034 1138 raft_consensus.cc:374] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.003054 1138 raft_consensus.cc:729] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.003150 1138 consensus_queue.cc:260] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.003351 1138 ts_tablet_manager.cc:1428] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:40:24.003419 687 heartbeater.cc:503] Master 127.29.168.254:33553 was elected leader, sending a full tablet report...
W20260808 14:40:24.055915 885 tablet.cc:2369] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:40:24.158241 688 tablet.cc:2369] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:24.202847 1144 raft_consensus.cc:482] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:24.203003 1144 raft_consensus.cc:504] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.203423 1144 leader_election.cc:288] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
W20260808 14:40:24.205279 1103 tablet.cc:2369] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:24.206532 1124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.203729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:58353 (local address 127.29.168.194:33115)
0808 14:40:24.203787 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:24.203790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:24.203866 (+ 76us) server_negotiation.cc:407] Connection header received
0808 14:40:24.203952 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:24.203953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:24.203971 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:24.204029 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:24.204169 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.204598 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.205789 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.206151 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.206233 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.206243 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:24.206407 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 14:40:24.206446 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:24.206542 1123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.203803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:47367 (local address 127.29.168.195:44097)
0808 14:40:24.203870 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:24.203872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:24.203882 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:24.203951 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:24.203952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:24.203960 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:24.204018 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:24.204155 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.204595 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.205789 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.206157 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.206262 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.206271 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:24.206425 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:40:24.206463 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:40:24.206571 1146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.203676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:33115 (local address 127.29.168.193:58353)
0808 14:40:24.203800 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:24.203811 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:24.203881 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:24.204034 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:24.204035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:24.204037 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:24.204107 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.204109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.204701 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.204702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.205686 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.205689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.206233 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.206234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.206305 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.206316 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:40:24.206398 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:40:24.206444 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":1,"thread_start_us":62,"threads_started":1}
I20260808 14:40:24.206578 1145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.203681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44097 (local address 127.29.168.193:47367)
0808 14:40:24.203814 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:24.203828 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:24.203883 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:24.204021 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:24.204023 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:24.204025 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:24.204086 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.204092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.204704 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.204705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.205662 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.205665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.206262 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.206263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.206334 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.206337 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:24.206406 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:40:24.206455 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":44,"thread_start_us":68,"threads_started":1}
I20260808 14:40:24.206905 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb42ab61f274cafae2b436104a02e58" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63" is_pre_election: true
I20260808 14:40:24.207059 816 raft_consensus.cc:2454] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:24.207083 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb42ab61f274cafae2b436104a02e58" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00" is_pre_election: true
I20260808 14:40:24.207244 1030 raft_consensus.cc:2454] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:24.207299 518 leader_election.cc:302] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 131d9814935e4eafb78671ee1cdccd63; no voters:
I20260808 14:40:24.207443 1144 raft_consensus.cc:2781] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:24.207511 1144 raft_consensus.cc:482] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:24.207530 1144 raft_consensus.cc:3037] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.208280 1144 raft_consensus.cc:504] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.208415 1144 leader_election.cc:288] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Requested vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:24.208563 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb42ab61f274cafae2b436104a02e58" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00"
I20260808 14:40:24.208593 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cb42ab61f274cafae2b436104a02e58" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63"
I20260808 14:40:24.208637 1030 raft_consensus.cc:3037] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.208652 816 raft_consensus.cc:3037] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.209502 816 raft_consensus.cc:2454] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:24.209502 1030 raft_consensus.cc:2454] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:24.209682 519 leader_election.cc:302] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 3f833743d35040d1b0ecef1a52bd9a00; no voters:
I20260808 14:40:24.209782 1144 raft_consensus.cc:2781] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:24.209892 1144 raft_consensus.cc:686] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 LEADER]: Becoming Leader. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Running, Role: LEADER
I20260808 14:40:24.209995 1144 consensus_queue.cc:237] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } }
I20260808 14:40:24.210700 379 catalog_manager.cc:5495] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } health_report { overall_health: HEALTHY } } }
Aug 08 14:40:24 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200023, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:24.238740 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.232371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54186 (local address 127.29.168.254:33553)
0808 14:40:24.232452 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:24.232454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:24.232572 (+ 118us) server_negotiation.cc:407] Connection header received
0808 14:40:24.232659 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:24.232660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:24.232682 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:24.232765 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:24.233211 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.233662 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.234367 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.234532 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.234617 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.236638 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:24.236640 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:24.236640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:24.236647 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:24.237683 (+ 1036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:24.238025 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:24.238026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:24.238027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:24.238077 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:24.238251 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:24.238252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:24.238252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:24.238351 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:24.238418 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:24.238569 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:40:24.238645 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:40:24.238845 1156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.232285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33553 (local address 127.0.0.1:54186)
0808 14:40:24.232502 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:24.232512 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:24.232590 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:24.232770 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:24.232771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:24.233100 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:24.233137 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.233139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.233737 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.233738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.234286 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.234288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.234618 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.234619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.234685 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.235187 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:24.235191 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:24.236552 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:24.237769 (+ 1217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:24.237776 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:24.237778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:24.237947 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:24.238145 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:24.238146 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:24.238146 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:24.238197 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:24.238410 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:24.238417 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:24.238455 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:40:24.238548 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:40:24.238713 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":74,"thread_start_us":120,"threads_started":1}
I20260808 14:40:24.240695 379 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:54186:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:40:24.240890 379 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:24.242287 584 tablet_service.cc:1467] Processing CreateTablet for tablet 2a09c677fe814ea985942910a63c6562 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=71c11cb7104a4db3883bb88e6c261e7f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:24.242287 786 tablet_service.cc:1467] Processing CreateTablet for tablet 2a09c677fe814ea985942910a63c6562 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=71c11cb7104a4db3883bb88e6c261e7f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:24.242451 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a09c677fe814ea985942910a63c6562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:24.242451 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a09c677fe814ea985942910a63c6562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:24.243804 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 2a09c677fe814ea985942910a63c6562 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=71c11cb7104a4db3883bb88e6c261e7f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:24.243891 1138 tablet_bootstrap.cc:492] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: Bootstrap starting.
I20260808 14:40:24.243995 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a09c677fe814ea985942910a63c6562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:24.244315 1138 tablet_bootstrap.cc:654] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.244896 1134 tablet_bootstrap.cc:492] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: Bootstrap starting.
I20260808 14:40:24.245577 1134 tablet_bootstrap.cc:654] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.245666 1132 tablet_bootstrap.cc:492] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: Bootstrap starting.
I20260808 14:40:24.246089 1138 tablet_bootstrap.cc:492] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: No bootstrap required, opened a new log
I20260808 14:40:24.246137 1138 ts_tablet_manager.cc:1397] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:24.246150 1132 tablet_bootstrap.cc:654] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.246243 1134 tablet_bootstrap.cc:492] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: No bootstrap required, opened a new log
I20260808 14:40:24.246299 1134 ts_tablet_manager.cc:1397] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:24.246317 1138 raft_consensus.cc:348] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.246387 1138 raft_consensus.cc:374] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.246411 1138 raft_consensus.cc:729] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.246459 1138 consensus_queue.cc:260] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.246459 1134 raft_consensus.cc:348] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.246564 1134 raft_consensus.cc:374] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.246578 1138 ts_tablet_manager.cc:1428] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:24.246593 1134 raft_consensus.cc:729] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131d9814935e4eafb78671ee1cdccd63, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.246636 1134 consensus_queue.cc:260] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.246618 1144 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.246695 1144 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.246728 1134 ts_tablet_manager.cc:1428] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:24.246846 1143 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.246932 1143 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.247045 1132 tablet_bootstrap.cc:492] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: No bootstrap required, opened a new log
I20260808 14:40:24.247116 1132 ts_tablet_manager.cc:1397] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:24.247296 1132 raft_consensus.cc:348] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.247390 1132 raft_consensus.cc:374] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.247417 1132 raft_consensus.cc:729] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f833743d35040d1b0ecef1a52bd9a00, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.247457 1132 consensus_queue.cc:260] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.247552 1132 ts_tablet_manager.cc:1428] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:24.247607 1137 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.247730 1137 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.489173 1144 raft_consensus.cc:482] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:24.489286 1144 raft_consensus.cc:504] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.489501 1144 leader_election.cc:288] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:24.489708 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a09c677fe814ea985942910a63c6562" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00" is_pre_election: true
I20260808 14:40:24.489711 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a09c677fe814ea985942910a63c6562" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63" is_pre_election: true
I20260808 14:40:24.489832 1030 raft_consensus.cc:2454] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:24.489833 816 raft_consensus.cc:2454] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:24.490020 518 leader_election.cc:302] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 131d9814935e4eafb78671ee1cdccd63; no voters:
I20260808 14:40:24.490140 1144 raft_consensus.cc:2781] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:24.490202 1144 raft_consensus.cc:482] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:24.490234 1144 raft_consensus.cc:3037] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.491276 1144 raft_consensus.cc:504] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.491428 1144 leader_election.cc:288] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Requested vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:24.491693 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a09c677fe814ea985942910a63c6562" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00"
I20260808 14:40:24.491698 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a09c677fe814ea985942910a63c6562" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63"
I20260808 14:40:24.491912 816 raft_consensus.cc:3037] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.491923 1030 raft_consensus.cc:3037] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.492859 1030 raft_consensus.cc:2454] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:24.492990 816 raft_consensus.cc:2454] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:24.493155 519 leader_election.cc:302] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 3f833743d35040d1b0ecef1a52bd9a00; no voters:
I20260808 14:40:24.493261 1144 raft_consensus.cc:2781] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:24.493306 1144 raft_consensus.cc:686] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 LEADER]: Becoming Leader. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Running, Role: LEADER
I20260808 14:40:24.493358 1144 consensus_queue.cc:237] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.493620 1144 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: TxnStatusTablet state changed. Reason: New leader 05ac7fd723684a0f97d32643ec0707c7. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.493683 1144 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:24.493974 379 catalog_manager.cc:5495] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:24.494361 1165 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:40:24.494506 1165 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:40:24.530535 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.527540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51284 (local address 127.29.168.193:38029)
0808 14:40:24.527697 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:24.527699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:24.527767 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:40:24.527875 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:24.527876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:24.527893 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:24.527960 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:24.528111 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.528598 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.529693 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.529931 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.529988 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.530203 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:24.530306 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:24.530369 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:24.530451 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:40:24.530466 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":61,"threads_started":1}
I20260808 14:40:24.530606 1156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.527441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38029 (local address 127.0.0.1:51284)
0808 14:40:24.527691 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:24.527704 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:24.527775 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:24.527989 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:24.527990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:24.527991 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:24.528045 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.528048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.528668 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.528669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.529601 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.529604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.530010 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.530011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.530086 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.530103 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:24.530379 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:24.530390 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:40:24.530448 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:40:24.530503 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182}
I20260808 14:40:24.532429 816 raft_consensus.cc:1261] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:24.532755 1030 raft_consensus.cc:1261] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:24.532817 1148 consensus_queue.cc:1035] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:24.533138 1148 consensus_queue.cc:1035] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:24.534226 1143 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: TxnStatusTablet state changed. Reason: New leader 05ac7fd723684a0f97d32643ec0707c7. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.534313 1143 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.535250 1137 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: TxnStatusTablet state changed. Reason: New leader 05ac7fd723684a0f97d32643ec0707c7. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.535333 1137 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.535871 1144 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.535955 1144 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:24.535988 1143 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.536072 1143 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 131d9814935e4eafb78671ee1cdccd63: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.536211 1148 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.536278 1148 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 05ac7fd723684a0f97d32643ec0707c7: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:24.536615 1137 tablet_replica.cc:439] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } } }
I20260808 14:40:24.536705 1137 tablet_replica.cc:442] T 2a09c677fe814ea985942910a63c6562 P 3f833743d35040d1b0ecef1a52bd9a00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:24.537103 1171 mvcc.cc:205] Tried to move back new op lower bound from 7316275300482080768 to 7316275300325142528. Current Snapshot: MvccSnapshot[applied={T|T < 7316275300482080768}]
I20260808 14:40:24.537222 1173 mvcc.cc:205] Tried to move back new op lower bound from 7316275300482080768 to 7316275300325142528. Current Snapshot: MvccSnapshot[applied={T|T < 7316275300482080768}]
I20260808 14:40:24.537549 1175 mvcc.cc:205] Tried to move back new op lower bound from 7316275300482080768 to 7316275300325142528. Current Snapshot: MvccSnapshot[applied={T|T < 7316275300482080768}]
I20260808 14:40:24.541211 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.538513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.29.168.193:38029)
0808 14:40:24.538555 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:24.538557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:24.538636 (+ 79us) server_negotiation.cc:407] Connection header received
0808 14:40:24.538723 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:24.538723 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:24.538730 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:24.538766 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:24.538912 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.539466 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.540601 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.540774 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.540819 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.540983 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:24.541004 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:24.541034 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:24.541141 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:40:24.541171 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:24.546023 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.543669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:41411 (local address 127.29.168.193:38029)
0808 14:40:24.543703 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:24.543705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:24.543813 (+ 108us) server_negotiation.cc:407] Connection header received
0808 14:40:24.543869 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:24.543869 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:24.543884 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:24.543921 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:24.544060 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.544427 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.545476 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.545624 (+ 148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.545663 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.545860 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:24.545879 (+ 19us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:24.545912 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:24.545959 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 14:40:24.545971 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:24.546100 1187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:24.543579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38029 (local address 127.29.168.193:41411)
0808 14:40:24.543743 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:24.543752 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:24.543809 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:24.543932 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:24.543932 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:24.543934 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:24.544009 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.544011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.544494 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.544494 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.545398 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:24.545401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:24.545687 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:24.545688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:24.545752 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:24.545764 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:24.545913 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:24.545915 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:24.545958 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:40:24.545994 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":98,"threads_started":1}
I20260808 14:40:24.547976 816 raft_consensus.cc:1261] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:24.548055 1030 raft_consensus.cc:1261] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:24.548151 1188 consensus_queue.cc:1035] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:24.548249 1144 consensus_queue.cc:1035] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:24.560642 379 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:24.560775 379 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:24.561499 379 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Sending DeleteTablet for 3 replicas of tablet 5cb42ab61f274cafae2b436104a02e58
I20260808 14:40:24.561844 786 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cb42ab61f274cafae2b436104a02e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:24 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39152
I20260808 14:40:24.562070 1195 tablet_replica.cc:330] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: stopping tablet replica
I20260808 14:40:24.562132 584 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cb42ab61f274cafae2b436104a02e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:24 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51268
I20260808 14:40:24.562309 1195 raft_consensus.cc:2229] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:24.562311 379 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:40:24.562397 1195 raft_consensus.cc:2258] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 14:40:24.562454 379 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:24.562695 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cb42ab61f274cafae2b436104a02e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:24 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41162
I20260808 14:40:24.562845 1196 tablet_replica.cc:330] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: stopping tablet replica
I20260808 14:40:24.562929 1196 raft_consensus.cc:2229] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:24.563017 1196 raft_consensus.cc:2258] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:24.563699 786 tablet_service.cc:1467] Processing CreateTablet for tablet aa6ef356f2724b52b57266fcad3313ca (DEFAULT_TABLE table=test-table [id=03bae73ed0f14e399b0aa24fb99ec124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:24.563699 584 tablet_service.cc:1467] Processing CreateTablet for tablet aa6ef356f2724b52b57266fcad3313ca (DEFAULT_TABLE table=test-table [id=03bae73ed0f14e399b0aa24fb99ec124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:24.563733 1002 tablet_service.cc:1467] Processing CreateTablet for tablet aa6ef356f2724b52b57266fcad3313ca (DEFAULT_TABLE table=test-table [id=03bae73ed0f14e399b0aa24fb99ec124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:24.563820 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa6ef356f2724b52b57266fcad3313ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:24.563820 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa6ef356f2724b52b57266fcad3313ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:24.563856 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa6ef356f2724b52b57266fcad3313ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:24.565007 1134 tablet_bootstrap.cc:492] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Bootstrap starting.
I20260808 14:40:24.565163 1132 tablet_bootstrap.cc:492] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Bootstrap starting.
I20260808 14:40:24.565372 1134 tablet_bootstrap.cc:654] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.565532 1132 tablet_bootstrap.cc:654] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.565706 1138 tablet_bootstrap.cc:492] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Bootstrap starting.
I20260808 14:40:24.566078 1138 tablet_bootstrap.cc:654] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:24.566188 1196 ts_tablet_manager.cc:1905] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:24.566692 1134 tablet_bootstrap.cc:492] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: No bootstrap required, opened a new log
I20260808 14:40:24.566763 1134 ts_tablet_manager.cc:1397] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:24.566915 1134 raft_consensus.cc:348] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.566993 1134 raft_consensus.cc:374] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.567021 1134 raft_consensus.cc:729] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131d9814935e4eafb78671ee1cdccd63, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.567062 1134 consensus_queue.cc:260] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.567153 1134 ts_tablet_manager.cc:1428] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:24.567483 1138 tablet_bootstrap.cc:492] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: No bootstrap required, opened a new log
I20260808 14:40:24.567556 1138 ts_tablet_manager.cc:1397] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:24.567732 1138 raft_consensus.cc:348] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.567822 1138 raft_consensus.cc:374] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.567850 1138 raft_consensus.cc:729] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.567889 1138 consensus_queue.cc:260] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.567974 1138 ts_tablet_manager.cc:1428] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:24.568084 1195 ts_tablet_manager.cc:1905] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:24.568248 1196 ts_tablet_manager.cc:1918] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:24.568326 1196 log.cc:1196] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/5cb42ab61f274cafae2b436104a02e58
I20260808 14:40:24.568580 1196 ts_tablet_manager.cc:1939] T 5cb42ab61f274cafae2b436104a02e58 P 05ac7fd723684a0f97d32643ec0707c7: Deleting consensus metadata
I20260808 14:40:24.569020 360 catalog_manager.cc:4841] TS 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029): tablet 5cb42ab61f274cafae2b436104a02e58 (table test-table [id=14bf4fe32d5942d5a333148128c2d109]) successfully deleted
I20260808 14:40:24.569207 1132 tablet_bootstrap.cc:492] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: No bootstrap required, opened a new log
I20260808 14:40:24.569260 1132 ts_tablet_manager.cc:1397] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260808 14:40:24.569397 1132 raft_consensus.cc:348] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.569458 1132 raft_consensus.cc:374] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:24.569478 1132 raft_consensus.cc:729] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f833743d35040d1b0ecef1a52bd9a00, State: Initialized, Role: FOLLOWER
I20260808 14:40:24.569511 1132 consensus_queue.cc:260] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.569589 1132 ts_tablet_manager.cc:1428] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:24.569985 1195 ts_tablet_manager.cc:1918] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:24.570050 1195 log.cc:1196] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/5cb42ab61f274cafae2b436104a02e58
I20260808 14:40:24.570305 1195 ts_tablet_manager.cc:1939] T 5cb42ab61f274cafae2b436104a02e58 P 131d9814935e4eafb78671ee1cdccd63: Deleting consensus metadata
I20260808 14:40:24.570647 1197 tablet_replica.cc:330] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: stopping tablet replica
I20260808 14:40:24.570657 358 catalog_manager.cc:4841] TS 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115): tablet 5cb42ab61f274cafae2b436104a02e58 (table test-table [id=14bf4fe32d5942d5a333148128c2d109]) successfully deleted
I20260808 14:40:24.570744 1197 raft_consensus.cc:2229] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:24.570803 1197 raft_consensus.cc:2258] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:24.571077 1197 ts_tablet_manager.cc:1905] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:24.572252 1197 ts_tablet_manager.cc:1918] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:24.572336 1197 log.cc:1196] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/5cb42ab61f274cafae2b436104a02e58
I20260808 14:40:24.572607 1197 ts_tablet_manager.cc:1939] T 5cb42ab61f274cafae2b436104a02e58 P 3f833743d35040d1b0ecef1a52bd9a00: Deleting consensus metadata
I20260808 14:40:24.573088 360 catalog_manager.cc:4841] TS 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097): tablet 5cb42ab61f274cafae2b436104a02e58 (table test-table [id=14bf4fe32d5942d5a333148128c2d109]) successfully deleted
I20260808 14:40:24.941922 1192 raft_consensus.cc:482] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:24.942019 1192 raft_consensus.cc:504] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.942206 1192 leader_election.cc:288] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:24.942473 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6ef356f2724b52b57266fcad3313ca" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00" is_pre_election: true
I20260808 14:40:24.942492 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6ef356f2724b52b57266fcad3313ca" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63" is_pre_election: true
I20260808 14:40:24.942584 1030 raft_consensus.cc:2454] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:24.942584 816 raft_consensus.cc:2454] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:24.942783 519 leader_election.cc:302] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 3f833743d35040d1b0ecef1a52bd9a00; no voters:
I20260808 14:40:24.942994 1192 raft_consensus.cc:2781] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:24.943053 1192 raft_consensus.cc:482] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:24.943068 1192 raft_consensus.cc:3037] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.943907 1192 raft_consensus.cc:504] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.944053 1192 leader_election.cc:288] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Requested vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:24.944245 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6ef356f2724b52b57266fcad3313ca" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63"
I20260808 14:40:24.944259 1030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6ef356f2724b52b57266fcad3313ca" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00"
I20260808 14:40:24.944327 816 raft_consensus.cc:3037] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.944326 1030 raft_consensus.cc:3037] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:24.945063 1030 raft_consensus.cc:2454] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:24.945063 816 raft_consensus.cc:2454] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:24.945271 518 leader_election.cc:302] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 131d9814935e4eafb78671ee1cdccd63; no voters:
I20260808 14:40:24.945412 1192 raft_consensus.cc:2781] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:24.945487 1192 raft_consensus.cc:686] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 1 LEADER]: Becoming Leader. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Running, Role: LEADER
I20260808 14:40:24.945541 1192 consensus_queue.cc:237] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:24.946134 379 catalog_manager.cc:5495] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:25.008975 816 raft_consensus.cc:1261] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:25.008977 1030 raft_consensus.cc:1261] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:25.009243 1192 consensus_queue.cc:1035] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:25.009382 1144 consensus_queue.cc:1035] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:40:25.014096 1171 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:40:26.531426 379 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:26.531523 379 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:26.532414 379 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Sending DeleteTablet for 3 replicas of tablet aa6ef356f2724b52b57266fcad3313ca
I20260808 14:40:26.532719 786 tablet_service.cc:1514] Processing DeleteTablet for tablet aa6ef356f2724b52b57266fcad3313ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:26 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39152
I20260808 14:40:26.532735 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet aa6ef356f2724b52b57266fcad3313ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:26 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41162
I20260808 14:40:26.532904 584 tablet_service.cc:1514] Processing DeleteTablet for tablet aa6ef356f2724b52b57266fcad3313ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:26 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51268
I20260808 14:40:26.533090 1246 tablet_replica.cc:330] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: stopping tablet replica
I20260808 14:40:26.533177 1246 raft_consensus.cc:2229] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:26.533265 1246 raft_consensus.cc:2258] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:26.533263 1240 tablet_replica.cc:330] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: stopping tablet replica
I20260808 14:40:26.533203 1244 tablet_replica.cc:330] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: stopping tablet replica
I20260808 14:40:26.533422 1240 raft_consensus.cc:2229] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:26.533521 1244 raft_consensus.cc:2229] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:26.533552 1246 ts_tablet_manager.cc:1905] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:26.533679 1244 raft_consensus.cc:2258] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:26.533771 1240 raft_consensus.cc:2258] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:26.534081 1244 ts_tablet_manager.cc:1905] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:26.534351 1240 ts_tablet_manager.cc:1905] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:26.535473 1246 ts_tablet_manager.cc:1918] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:40:26.535538 1246 log.cc:1196] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/aa6ef356f2724b52b57266fcad3313ca
I20260808 14:40:26.535799 1246 ts_tablet_manager.cc:1939] T aa6ef356f2724b52b57266fcad3313ca P 05ac7fd723684a0f97d32643ec0707c7: Deleting consensus metadata
I20260808 14:40:26.536154 1244 ts_tablet_manager.cc:1918] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:40:26.536162 360 catalog_manager.cc:4841] TS 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029): tablet aa6ef356f2724b52b57266fcad3313ca (table test-table [id=03bae73ed0f14e399b0aa24fb99ec124]) successfully deleted
I20260808 14:40:26.536211 1244 log.cc:1196] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/aa6ef356f2724b52b57266fcad3313ca
I20260808 14:40:26.536445 1244 ts_tablet_manager.cc:1939] T aa6ef356f2724b52b57266fcad3313ca P 3f833743d35040d1b0ecef1a52bd9a00: Deleting consensus metadata
I20260808 14:40:26.536752 360 catalog_manager.cc:4841] TS 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097): tablet aa6ef356f2724b52b57266fcad3313ca (table test-table [id=03bae73ed0f14e399b0aa24fb99ec124]) successfully deleted
I20260808 14:40:26.537740 1240 ts_tablet_manager.cc:1918] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:40:26.537815 1240 log.cc:1196] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/aa6ef356f2724b52b57266fcad3313ca
I20260808 14:40:26.537987 1240 ts_tablet_manager.cc:1939] T aa6ef356f2724b52b57266fcad3313ca P 131d9814935e4eafb78671ee1cdccd63: Deleting consensus metadata
I20260808 14:40:26.538296 358 catalog_manager.cc:4841] TS 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115): tablet aa6ef356f2724b52b57266fcad3313ca (table test-table [id=03bae73ed0f14e399b0aa24fb99ec124]) successfully deleted
Aug 08 14:40:26 dist-test-slave-mjjr krb5kdc[313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200026, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:40:26 dist-test-slave-mjjr krb5kdc[313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200026, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:26.561795 1260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.550727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50862 (local address 127.29.168.254:33553)
0808 14:40:26.550882 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:26.550884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:26.550969 (+ 85us) server_negotiation.cc:407] Connection header received
0808 14:40:26.551007 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:26.551007 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:26.551017 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:26.551085 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:26.551601 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.552142 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.552859 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.553051 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.553099 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.559347 (+ 6248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:26.559348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:26.559349 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:26.559355 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:26.560786 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:26.561098 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:26.561099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:26.561099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:26.561149 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:26.561303 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:26.561303 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:26.561304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:26.561419 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:26.561494 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:26.561620 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:40:26.561684 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":85,"threads_started":1}
I20260808 14:40:26.563241 379 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50862:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:26.563390 379 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:26.564776 584 tablet_service.cc:1467] Processing CreateTablet for tablet 341e925d14fa4f9aaf2ce106d36a5d6a (DEFAULT_TABLE table=test-table [id=fc04e0fe9f7a43b181879cb52dd80168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:26.564787 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 341e925d14fa4f9aaf2ce106d36a5d6a (DEFAULT_TABLE table=test-table [id=fc04e0fe9f7a43b181879cb52dd80168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:26.564913 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 341e925d14fa4f9aaf2ce106d36a5d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:26.564913 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 341e925d14fa4f9aaf2ce106d36a5d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:26.566226 1261 tablet_bootstrap.cc:492] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Bootstrap starting.
I20260808 14:40:26.566215 786 tablet_service.cc:1467] Processing CreateTablet for tablet 341e925d14fa4f9aaf2ce106d36a5d6a (DEFAULT_TABLE table=test-table [id=fc04e0fe9f7a43b181879cb52dd80168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:26.566321 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 341e925d14fa4f9aaf2ce106d36a5d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:26.566646 1261 tablet_bootstrap.cc:654] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:26.566972 1262 tablet_bootstrap.cc:492] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Bootstrap starting.
I20260808 14:40:26.567251 1261 tablet_bootstrap.cc:492] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: No bootstrap required, opened a new log
I20260808 14:40:26.567306 1262 tablet_bootstrap.cc:654] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:26.567313 1261 ts_tablet_manager.cc:1397] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.567453 1261 raft_consensus.cc:348] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.567525 1264 tablet_bootstrap.cc:492] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Bootstrap starting.
I20260808 14:40:26.567612 1261 raft_consensus.cc:374] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:26.567718 1261 raft_consensus.cc:729] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Initialized, Role: FOLLOWER
I20260808 14:40:26.567840 1261 consensus_queue.cc:260] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.568035 1262 tablet_bootstrap.cc:492] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: No bootstrap required, opened a new log
I20260808 14:40:26.567991 1264 tablet_bootstrap.cc:654] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:26.568084 1262 ts_tablet_manager.cc:1397] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.568229 1261 ts_tablet_manager.cc:1428] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.568424 1262 raft_consensus.cc:348] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.568495 1262 raft_consensus.cc:374] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:26.568513 1262 raft_consensus.cc:729] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f833743d35040d1b0ecef1a52bd9a00, State: Initialized, Role: FOLLOWER
I20260808 14:40:26.568567 1262 consensus_queue.cc:260] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.568742 1262 ts_tablet_manager.cc:1428] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.568802 1264 tablet_bootstrap.cc:492] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: No bootstrap required, opened a new log
I20260808 14:40:26.568877 1264 ts_tablet_manager.cc:1397] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.569031 1264 raft_consensus.cc:348] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.569106 1264 raft_consensus.cc:374] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:26.569151 1264 raft_consensus.cc:729] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131d9814935e4eafb78671ee1cdccd63, State: Initialized, Role: FOLLOWER
I20260808 14:40:26.569219 1264 consensus_queue.cc:260] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.569396 1264 ts_tablet_manager.cc:1428] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:26.780951 1271 raft_consensus.cc:482] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:26.781045 1271 raft_consensus.cc:504] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.781409 1271 leader_election.cc:288] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:26.785555 1272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.781601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38029 (local address 127.29.168.194:60059)
0808 14:40:26.781804 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:26.781817 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:26.781874 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:26.782070 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:26.782071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:26.782074 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:26.782158 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.782160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.783141 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.783141 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.784779 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.784783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.785353 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.785353 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.785418 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.785422 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:26.785463 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 14:40:26.785495 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":97,"thread_start_us":130,"threads_started":1}
I20260808 14:40:26.785614 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.781689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:60059 (local address 127.29.168.193:38029)
0808 14:40:26.781904 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:26.781907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:26.781918 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:26.781950 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:26.781951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:26.781963 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:26.782055 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:26.782243 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.783068 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.784874 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.785274 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.785352 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.785362 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:26.785489 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:40:26.785538 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":138,"threads_started":1}
I20260808 14:40:26.785830 615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "341e925d14fa4f9aaf2ce106d36a5d6a" candidate_uuid: "131d9814935e4eafb78671ee1cdccd63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05ac7fd723684a0f97d32643ec0707c7" is_pre_election: true
I20260808 14:40:26.786017 615 raft_consensus.cc:2454] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131d9814935e4eafb78671ee1cdccd63 in term 0.
I20260808 14:40:26.786265 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.781872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44097 (local address 127.29.168.194:35493)
0808 14:40:26.781996 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:26.782003 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:26.782062 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:26.782276 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:26.782276 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:26.782279 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:26.782331 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.782333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.783201 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.783202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.785186 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.785189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.785964 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.785965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.786059 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.786063 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:26.786115 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:40:26.786162 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":83,"thread_start_us":76,"threads_started":1}
I20260808 14:40:26.786274 1276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.781966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:35493 (local address 127.29.168.195:44097)
0808 14:40:26.782123 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:26.782125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:26.782132 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:26.782163 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:26.782163 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:26.782171 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:26.782273 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:26.782403 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.783110 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.785276 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.785856 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.785944 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.785954 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:26.786143 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:40:26.786179 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260808 14:40:26.786247 729 leader_election.cc:302] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 131d9814935e4eafb78671ee1cdccd63; no voters:
I20260808 14:40:26.786405 1271 raft_consensus.cc:2781] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:26.786433 1271 raft_consensus.cc:482] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:26.786450 1271 raft_consensus.cc:3037] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:26.786633 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "341e925d14fa4f9aaf2ce106d36a5d6a" candidate_uuid: "131d9814935e4eafb78671ee1cdccd63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00" is_pre_election: true
I20260808 14:40:26.786713 1029 raft_consensus.cc:2454] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 131d9814935e4eafb78671ee1cdccd63 in term 0.
I20260808 14:40:26.787289 1271 raft_consensus.cc:504] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.787432 1271 leader_election.cc:288] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [CANDIDATE]: Term 1 election: Requested vote from peers 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:26.787567 615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "341e925d14fa4f9aaf2ce106d36a5d6a" candidate_uuid: "131d9814935e4eafb78671ee1cdccd63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05ac7fd723684a0f97d32643ec0707c7"
I20260808 14:40:26.787609 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "341e925d14fa4f9aaf2ce106d36a5d6a" candidate_uuid: "131d9814935e4eafb78671ee1cdccd63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00"
I20260808 14:40:26.787683 615 raft_consensus.cc:3037] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:26.787704 1029 raft_consensus.cc:3037] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:26.788525 1029 raft_consensus.cc:2454] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131d9814935e4eafb78671ee1cdccd63 in term 1.
I20260808 14:40:26.788573 615 raft_consensus.cc:2454] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 131d9814935e4eafb78671ee1cdccd63 in term 1.
I20260808 14:40:26.788722 729 leader_election.cc:302] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 131d9814935e4eafb78671ee1cdccd63, 3f833743d35040d1b0ecef1a52bd9a00; no voters:
I20260808 14:40:26.788825 1271 raft_consensus.cc:2781] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:26.788998 1271 raft_consensus.cc:686] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 1 LEADER]: Becoming Leader. State: Replica: 131d9814935e4eafb78671ee1cdccd63, State: Running, Role: LEADER
I20260808 14:40:26.789074 1271 consensus_queue.cc:237] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.789925 376 catalog_manager.cc:5495] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194). New cstate: current_term: 1 leader_uuid: "131d9814935e4eafb78671ee1cdccd63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:26.852201 1284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.849605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50926 (local address 127.29.168.194:33115)
0808 14:40:26.849857 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:26.849859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:26.849865 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:26.849901 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:26.849902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:26.849922 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:26.849987 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:26.850147 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.850755 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.851427 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.851600 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.851684 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.851872 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:26.851977 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:26.852033 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:26.852064 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 14:40:26.852080 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":198,"threads_started":1}
I20260808 14:40:26.857093 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.854774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:60907 (local address 127.29.168.193:38029)
0808 14:40:26.854837 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:26.854844 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:26.854934 (+ 90us) server_negotiation.cc:407] Connection header received
0808 14:40:26.854983 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:26.854983 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:26.854991 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:26.855042 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:26.855223 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.855675 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.856493 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.856682 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.856734 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.856899 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:26.856923 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:26.856964 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:26.857028 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:40:26.857044 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:40:26.857124 1287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.854678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38029 (local address 127.29.168.194:60907)
0808 14:40:26.854864 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:26.854874 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:26.854935 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:26.855075 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:26.855076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:26.855078 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:26.855167 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.855168 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.855773 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.855773 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.856416 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.856418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.856765 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.856766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.856816 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.856830 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:26.856982 (+ 152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:26.856984 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:26.857025 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 14:40:26.857060 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
I20260808 14:40:26.859630 1029 raft_consensus.cc:1261] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Refusing update from remote peer 131d9814935e4eafb78671ee1cdccd63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:26.859776 615 raft_consensus.cc:1261] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Refusing update from remote peer 131d9814935e4eafb78671ee1cdccd63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:26.859915 1277 consensus_queue.cc:1035] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:26.860018 1271 consensus_queue.cc:1035] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:26.867086 1284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.864754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:58161 (local address 127.29.168.194:33115)
0808 14:40:26.864789 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:26.864791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:26.864959 (+ 168us) server_negotiation.cc:407] Connection header received
0808 14:40:26.865066 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:26.865067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:26.865076 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:26.865118 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:26.865210 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.865626 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.866283 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.866524 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.866627 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.866834 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:26.866885 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:26.866943 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:26.866996 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:40:26.867018 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:40:26.867131 1294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:26.864689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:33115 (local address 127.29.168.193:58161)
0808 14:40:26.864828 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:26.864841 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:26.864993 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:26.865124 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:26.865125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:26.865127 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:26.865174 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.865175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.865681 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.865681 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.866204 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:26.866205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:26.866630 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:26.866631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:26.866713 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:26.866718 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:26.866946 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:26.866948 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:26.866994 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:40:26.867050 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":96,"threads_started":1}
I20260808 14:40:26.873847 376 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:26.873965 376 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:26.874629 376 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Sending DeleteTablet for 3 replicas of tablet 341e925d14fa4f9aaf2ce106d36a5d6a
I20260808 14:40:26.874853 584 tablet_service.cc:1514] Processing DeleteTablet for tablet 341e925d14fa4f9aaf2ce106d36a5d6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:26 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51268
I20260808 14:40:26.874876 786 tablet_service.cc:1514] Processing DeleteTablet for tablet 341e925d14fa4f9aaf2ce106d36a5d6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:26 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39152
I20260808 14:40:26.874918 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 341e925d14fa4f9aaf2ce106d36a5d6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:26 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41162
I20260808 14:40:26.874944 1246 tablet_replica.cc:330] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: stopping tablet replica
I20260808 14:40:26.874956 1240 tablet_replica.cc:330] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: stopping tablet replica
I20260808 14:40:26.874992 1246 raft_consensus.cc:2229] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:26.874996 1244 tablet_replica.cc:330] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: stopping tablet replica
I20260808 14:40:26.874997 1240 raft_consensus.cc:2229] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:26.875028 1246 raft_consensus.cc:2258] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:26.875030 1244 raft_consensus.cc:2229] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:26.875066 1244 raft_consensus.cc:2258] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:26.875066 1240 raft_consensus.cc:2258] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:26.875339 1246 ts_tablet_manager.cc:1905] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:26.875376 1244 ts_tablet_manager.cc:1905] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:26.875376 1240 ts_tablet_manager.cc:1905] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:26.877038 1244 ts_tablet_manager.cc:1918] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:26.877054 1240 ts_tablet_manager.cc:1918] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:26.877099 1244 log.cc:1196] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/341e925d14fa4f9aaf2ce106d36a5d6a
I20260808 14:40:26.877099 1240 log.cc:1196] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/341e925d14fa4f9aaf2ce106d36a5d6a
I20260808 14:40:26.877310 1240 ts_tablet_manager.cc:1939] T 341e925d14fa4f9aaf2ce106d36a5d6a P 131d9814935e4eafb78671ee1cdccd63: Deleting consensus metadata
I20260808 14:40:26.877310 1244 ts_tablet_manager.cc:1939] T 341e925d14fa4f9aaf2ce106d36a5d6a P 3f833743d35040d1b0ecef1a52bd9a00: Deleting consensus metadata
I20260808 14:40:26.877610 358 catalog_manager.cc:4841] TS 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115): tablet 341e925d14fa4f9aaf2ce106d36a5d6a (table test-table [id=fc04e0fe9f7a43b181879cb52dd80168]) successfully deleted
I20260808 14:40:26.877628 360 catalog_manager.cc:4841] TS 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097): tablet 341e925d14fa4f9aaf2ce106d36a5d6a (table test-table [id=fc04e0fe9f7a43b181879cb52dd80168]) successfully deleted
I20260808 14:40:26.877843 376 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50862:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:26.878019 376 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:26.878232 1246 ts_tablet_manager.cc:1918] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:26.878300 1246 log.cc:1196] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/341e925d14fa4f9aaf2ce106d36a5d6a
I20260808 14:40:26.878525 1246 ts_tablet_manager.cc:1939] T 341e925d14fa4f9aaf2ce106d36a5d6a P 05ac7fd723684a0f97d32643ec0707c7: Deleting consensus metadata
I20260808 14:40:26.878782 360 catalog_manager.cc:4841] TS 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029): tablet 341e925d14fa4f9aaf2ce106d36a5d6a (table test-table [id=fc04e0fe9f7a43b181879cb52dd80168]) successfully deleted
I20260808 14:40:26.879356 786 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf96871f02a491f911fb31232ad8028 (DEFAULT_TABLE table=test-table [id=d1f112262f7f46f48f885b1ed838ef0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:26.879356 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf96871f02a491f911fb31232ad8028 (DEFAULT_TABLE table=test-table [id=d1f112262f7f46f48f885b1ed838ef0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:26.879400 584 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf96871f02a491f911fb31232ad8028 (DEFAULT_TABLE table=test-table [id=d1f112262f7f46f48f885b1ed838ef0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:26.879468 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf96871f02a491f911fb31232ad8028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:26.879469 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf96871f02a491f911fb31232ad8028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:26.879501 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf96871f02a491f911fb31232ad8028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:26.880589 1262 tablet_bootstrap.cc:492] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Bootstrap starting.
I20260808 14:40:26.880589 1264 tablet_bootstrap.cc:492] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Bootstrap starting.
I20260808 14:40:26.880990 1264 tablet_bootstrap.cc:654] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:26.880990 1262 tablet_bootstrap.cc:654] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:26.881314 1261 tablet_bootstrap.cc:492] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7: Bootstrap starting.
I20260808 14:40:26.881587 1261 tablet_bootstrap.cc:654] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:26.881628 1264 tablet_bootstrap.cc:492] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: No bootstrap required, opened a new log
I20260808 14:40:26.881670 1264 ts_tablet_manager.cc:1397] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.881871 1264 raft_consensus.cc:348] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.881943 1264 raft_consensus.cc:374] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:26.881970 1264 raft_consensus.cc:729] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131d9814935e4eafb78671ee1cdccd63, State: Initialized, Role: FOLLOWER
I20260808 14:40:26.882014 1264 consensus_queue.cc:260] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.882146 1264 ts_tablet_manager.cc:1428] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:26.882159 1261 tablet_bootstrap.cc:492] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7: No bootstrap required, opened a new log
I20260808 14:40:26.882203 1261 ts_tablet_manager.cc:1397] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:26.882310 1261 raft_consensus.cc:348] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.882391 1261 raft_consensus.cc:374] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:26.882416 1261 raft_consensus.cc:729] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Initialized, Role: FOLLOWER
I20260808 14:40:26.882449 1262 tablet_bootstrap.cc:492] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: No bootstrap required, opened a new log
I20260808 14:40:26.882465 1261 consensus_queue.cc:260] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.882501 1262 ts_tablet_manager.cc:1397] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:26.882575 1261 ts_tablet_manager.cc:1428] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:26.882647 1262 raft_consensus.cc:348] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.882722 1262 raft_consensus.cc:374] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:26.882758 1262 raft_consensus.cc:729] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f833743d35040d1b0ecef1a52bd9a00, State: Initialized, Role: FOLLOWER
I20260808 14:40:26.882807 1262 consensus_queue.cc:260] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.882898 1262 ts_tablet_manager.cc:1428] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:26.975484 1144 raft_consensus.cc:482] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:26.975574 1144 raft_consensus.cc:504] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.975770 1144 leader_election.cc:288] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:26.975966 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf96871f02a491f911fb31232ad8028" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63" is_pre_election: true
I20260808 14:40:26.976086 816 raft_consensus.cc:2454] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:26.976046 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf96871f02a491f911fb31232ad8028" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00" is_pre_election: true
I20260808 14:40:26.976155 1029 raft_consensus.cc:2454] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 0.
I20260808 14:40:26.976289 518 leader_election.cc:302] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 131d9814935e4eafb78671ee1cdccd63; no voters:
I20260808 14:40:26.976413 1144 raft_consensus.cc:2781] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:26.976471 1144 raft_consensus.cc:482] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:26.976487 1144 raft_consensus.cc:3037] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:26.977301 1144 raft_consensus.cc:504] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.977432 1144 leader_election.cc:288] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Requested vote from peers 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115), 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097)
I20260808 14:40:26.977561 1029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf96871f02a491f911fb31232ad8028" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f833743d35040d1b0ecef1a52bd9a00"
I20260808 14:40:26.977578 816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf96871f02a491f911fb31232ad8028" candidate_uuid: "05ac7fd723684a0f97d32643ec0707c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131d9814935e4eafb78671ee1cdccd63"
I20260808 14:40:26.977648 1029 raft_consensus.cc:3037] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:26.977655 816 raft_consensus.cc:3037] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:26.978435 1029 raft_consensus.cc:2454] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:26.978560 816 raft_consensus.cc:2454] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05ac7fd723684a0f97d32643ec0707c7 in term 1.
I20260808 14:40:26.978600 519 leader_election.cc:302] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05ac7fd723684a0f97d32643ec0707c7, 3f833743d35040d1b0ecef1a52bd9a00; no voters:
I20260808 14:40:26.978688 1144 raft_consensus.cc:2781] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:26.978730 1144 raft_consensus.cc:686] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [term 1 LEADER]: Becoming Leader. State: Replica: 05ac7fd723684a0f97d32643ec0707c7, State: Running, Role: LEADER
I20260808 14:40:26.978782 1144 consensus_queue.cc:237] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } }
I20260808 14:40:26.979434 379 catalog_manager.cc:5495] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "05ac7fd723684a0f97d32643ec0707c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05ac7fd723684a0f97d32643ec0707c7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:27.004153 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:27.001906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35982 (local address 127.29.168.193:38029)
0808 14:40:27.001960 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:27.001963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:27.001973 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:27.002024 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:27.002025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:27.002039 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:27.002094 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:27.002208 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:27.002699 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:27.003440 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:27.003633 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:27.003739 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:27.003894 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:27.003932 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:27.003992 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:27.004049 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:40:27.004074 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:40:27.006479 816 raft_consensus.cc:1261] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:27.006456 1029 raft_consensus.cc:1261] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Refusing update from remote peer 05ac7fd723684a0f97d32643ec0707c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:27.006719 1227 consensus_queue.cc:1035] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f833743d35040d1b0ecef1a52bd9a00" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:27.006832 1144 consensus_queue.cc:1035] T 7cf96871f02a491f911fb31232ad8028 P 05ac7fd723684a0f97d32643ec0707c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131d9814935e4eafb78671ee1cdccd63" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 33115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:40:27.011195 1207 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:40:28.531384 379 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:28.531498 379 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:28.532487 379 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34266c9a0de541e991bf8df87ecbba15: Sending DeleteTablet for 3 replicas of tablet 7cf96871f02a491f911fb31232ad8028
I20260808 14:40:28.532747 584 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf96871f02a491f911fb31232ad8028 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:28 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51268
I20260808 14:40:28.532975 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 490
I20260808 14:40:28.533015 1002 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf96871f02a491f911fb31232ad8028 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:28 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41162
I20260808 14:40:28.533488 786 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf96871f02a491f911fb31232ad8028 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:28 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39152
I20260808 14:40:28.536616 1334 tablet_replica.cc:330] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: stopping tablet replica
I20260808 14:40:28.536679 1334 raft_consensus.cc:2229] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:28.536722 1334 raft_consensus.cc:2258] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:28.537685 1334 ts_tablet_manager.cc:1905] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:28.539656 1334 ts_tablet_manager.cc:1918] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:40:28.539726 1334 log.cc:1196] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/7cf96871f02a491f911fb31232ad8028
I20260808 14:40:28.539961 1334 ts_tablet_manager.cc:1939] T 7cf96871f02a491f911fb31232ad8028 P 131d9814935e4eafb78671ee1cdccd63: Deleting consensus metadata
I20260808 14:40:28.540021 1332 tablet_replica.cc:330] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: stopping tablet replica
I20260808 14:40:28.540154 1332 raft_consensus.cc:2229] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:28.540237 1332 raft_consensus.cc:2258] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:28.540342 358 catalog_manager.cc:4841] TS 131d9814935e4eafb78671ee1cdccd63 (127.29.168.194:33115): tablet 7cf96871f02a491f911fb31232ad8028 (table test-table [id=d1f112262f7f46f48f885b1ed838ef0d]) successfully deleted
I20260808 14:40:28.540601 1332 ts_tablet_manager.cc:1905] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:28.542665 1332 ts_tablet_manager.cc:1918] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:40:28.542732 1332 log.cc:1196] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/7cf96871f02a491f911fb31232ad8028
I20260808 14:40:28.542948 1332 ts_tablet_manager.cc:1939] T 7cf96871f02a491f911fb31232ad8028 P 3f833743d35040d1b0ecef1a52bd9a00: Deleting consensus metadata
I20260808 14:40:28.543258 360 catalog_manager.cc:4841] TS 3f833743d35040d1b0ecef1a52bd9a00 (127.29.168.195:44097): tablet 7cf96871f02a491f911fb31232ad8028 (table test-table [id=d1f112262f7f46f48f885b1ed838ef0d]) successfully deleted
W20260808 14:40:28.548506 360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:38029 (error 108)
I20260808 14:40:28.548708 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 702
I20260808 14:40:28.554409 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:28.553561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38029 (local address 127.0.0.1:35990)
0808 14:40:28.554271 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:28.554339 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":639,"threads_started":1}
W20260808 14:40:28.554569 360 catalog_manager.cc:4584] TS 05ac7fd723684a0f97d32643ec0707c7 (127.29.168.193:38029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7cf96871f02a491f911fb31232ad8028: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38029: connect: Connection refused (error 111)
I20260808 14:40:28.559505 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 897
I20260808 14:40:28.569021 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 332
2026-08-08T14:40:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6517 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:28 dist-test-slave-mjjr krb5kdc[1339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:28 dist-test-slave-mjjr krb5kdc[1339](info): set up 2 sockets
Aug 08 14:40:28 dist-test-slave-mjjr krb5kdc[1339](info): commencing operation
krb5kdc: starting...
W20260808 14:40:29.732923 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:29 dist-test-slave-mjjr krb5kdc[1339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:29.842059 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:38363
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:38363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:29.920979 1358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:29.921168 1358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:29.921200 1358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:29.922295 1358 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:29.922336 1358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:29.922350 1358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:29.922401 1358 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:29.922420 1358 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:29.923926 1358 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:38363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:38363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:29.924170 1358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:29.924438 1358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:29.929356 1364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:29.930365 1358 server_base.cc:1034] running on GCE node
W20260808 14:40:29.930429 1368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:29.930756 1365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:29.931015 1358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:29.931310 1358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:29.932461 1358 hybrid_clock.cc:648] HybridClock initialized: now 1786200029932438 us; error 45 us; skew 500 ppm
Aug 08 14:40:29 dist-test-slave-mjjr krb5kdc[1339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200029, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:29.934921 1358 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:29.935276 1358 webserver.cc:460] Webserver started at http://127.29.168.254:34365/ using document root <none> and password file <none>
I20260808 14:40:29.935459 1358 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:29.935499 1358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:29.935580 1358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:29.936565 1358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "cf93b3e5dc8441eca0e3a30d1a290765"
format_stamp: "Formatted at 2026-08-08 14:40:29 on dist-test-slave-mjjr"
server_key: "92183a9f95167eb4c2d3c79f78546dcf"
server_key_iv: "f308c922567958e01317c58c644c8bb0"
server_key_version: "encryptionkey@0"
I20260808 14:40:29.936836 1358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "cf93b3e5dc8441eca0e3a30d1a290765"
format_stamp: "Formatted at 2026-08-08 14:40:29 on dist-test-slave-mjjr"
server_key: "92183a9f95167eb4c2d3c79f78546dcf"
server_key_iv: "f308c922567958e01317c58c644c8bb0"
server_key_version: "encryptionkey@0"
I20260808 14:40:29.937958 1358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:29.938589 1377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:29.938755 1358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:29.938849 1358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "cf93b3e5dc8441eca0e3a30d1a290765"
format_stamp: "Formatted at 2026-08-08 14:40:29 on dist-test-slave-mjjr"
server_key: "92183a9f95167eb4c2d3c79f78546dcf"
server_key_iv: "f308c922567958e01317c58c644c8bb0"
server_key_version: "encryptionkey@0"
I20260808 14:40:29.938902 1358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:29.950227 1358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:29.952348 1358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:29.952453 1358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:29.956664 1358 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:38363
I20260808 14:40:29.956710 1453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:38363 every 8 connection(s)
I20260808 14:40:29.956974 1358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:29.957772 1454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:29.959950 1454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765: Bootstrap starting.
I20260808 14:40:29.960466 1454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:29.960769 1454 log.cc:824] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:29.961421 1454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765: No bootstrap required, opened a new log
I20260808 14:40:29.962966 1454 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38363 } }
I20260808 14:40:29.963092 1454 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:29.963138 1454 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf93b3e5dc8441eca0e3a30d1a290765, State: Initialized, Role: FOLLOWER
I20260808 14:40:29.963294 1454 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38363 } }
I20260808 14:40:29.963353 1454 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:29.963394 1454 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:29.963442 1454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:29.963977 1454 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38363 } }
I20260808 14:40:29.964084 1454 leader_election.cc:302] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf93b3e5dc8441eca0e3a30d1a290765; no voters:
I20260808 14:40:29.964259 1454 leader_election.cc:288] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:29.964331 1458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:29.964509 1454 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:29.964718 1458 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [term 1 LEADER]: Becoming Leader. State: Replica: cf93b3e5dc8441eca0e3a30d1a290765, State: Running, Role: LEADER
I20260808 14:40:29.964813 1458 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38363 } }
I20260808 14:40:29.965142 1460 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38363 } } }
I20260808 14:40:29.965152 1461 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf93b3e5dc8441eca0e3a30d1a290765. Latest consensus state: current_term: 1 leader_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf93b3e5dc8441eca0e3a30d1a290765" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38363 } } }
I20260808 14:40:29.965234 1460 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:29.965258 1461 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:29.965449 1468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:29.965917 1468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:29.966223 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 1358
I20260808 14:40:29.966317 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:29.966508 30371 external_mini_cluster.cc:1428] Setting key b83210b5bf3c549ee8f9edb5527e47e5
I20260808 14:40:29.968842 1468 catalog_manager.cc:1347] Generated new cluster ID: b8749bddd65d49bdb0d05063fb6b786a
I20260808 14:40:29.968902 1468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:29 dist-test-slave-mjjr krb5kdc[1339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:29.975916 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:29.967012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.29.168.254:38363)
0808 14:40:29.967192 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:29.967209 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:29.967247 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:40:29.967364 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:29.967369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:29.967409 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:29.967535 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:29.968181 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:29.969433 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:29.970169 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:29.970600 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:29.970713 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:29.972955 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:29.972958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:29.972959 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:29.972970 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:29.974486 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:29.974830 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:29.974833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:29.974833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:29.974926 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:29.975124 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:29.975124 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:29.975125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:29.975334 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:29.975487 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:29.975573 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 14:40:29.975736 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260808 14:40:29.984094 1468 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:29.984587 1468 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:29.988101 1468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf93b3e5dc8441eca0e3a30d1a290765: Generated new TSK 0
I20260808 14:40:29.988248 1468 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:30.018416 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:38363
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:30.126200 1487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:30.126395 1487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:30.126428 1487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:30.127574 1487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:30.127635 1487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:30.127731 1487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:30.129096 1487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:38363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:30.129338 1487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:30.129549 1487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:30.134260 1499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:30.134266 1502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:30.134344 1498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:30.134594 1487 server_base.cc:1034] running on GCE node
I20260808 14:40:30.134797 1487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:30.135031 1487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:30.136166 1487 hybrid_clock.cc:648] HybridClock initialized: now 1786200030136148 us; error 35 us; skew 500 ppm
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[1339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200030, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:30.138641 1487 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:30.139066 1487 webserver.cc:460] Webserver started at http://127.29.168.193:40791/ using document root <none> and password file <none>
I20260808 14:40:30.139266 1487 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:30.139304 1487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:30.139385 1487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:30.140360 1487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "dfb8342847cc44878c27600036e1ce2f"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "905b2ddc7940dba0d3ec12a7e86df677"
server_key_iv: "fa3b915444a27b8ff955c1e999fc4618"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.140686 1487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "dfb8342847cc44878c27600036e1ce2f"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "905b2ddc7940dba0d3ec12a7e86df677"
server_key_iv: "fa3b915444a27b8ff955c1e999fc4618"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.141988 1487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:40:30.142709 1510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.142872 1487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:30.142957 1487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "dfb8342847cc44878c27600036e1ce2f"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "905b2ddc7940dba0d3ec12a7e86df677"
server_key_iv: "fa3b915444a27b8ff955c1e999fc4618"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.143028 1487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:30.154024 1487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:30.156143 1487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:30.156291 1487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:30.156507 1487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:30.156791 1487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:30.156841 1487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.156896 1487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:30.156920 1487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.163758 1487 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:44127
I20260808 14:40:30.163812 1672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:44127 every 8 connection(s)
I20260808 14:40:30.164100 1487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[1339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200030, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:30.172547 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:30.164797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:34489 (local address 127.29.168.254:38363)
0808 14:40:30.164844 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:30.164847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:30.165065 (+ 218us) server_negotiation.cc:407] Connection header received
0808 14:40:30.165514 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:30.165515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:30.165527 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:30.165573 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:30.166490 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.166994 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.167995 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.168173 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.168222 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:30.170096 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:30.170098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:30.170098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:30.170104 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:30.171310 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:30.171671 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:30.171672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:30.171672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:30.171743 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:30.171975 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:30.171975 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:30.171976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:30.172091 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:30.172144 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:30.172408 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:40:30.172481 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:30.172681 1675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:30.164795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:38363 (local address 127.29.168.193:34489)
0808 14:40:30.164941 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:30.164973 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:30.165430 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:30.165617 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:30.165620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:30.166223 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:30.166398 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:30.166403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.167071 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.167072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:30.167922 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:30.167924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.168240 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.168241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:30.168327 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:30.168686 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:30.168693 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:30.170016 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:30.171387 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:30.171393 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:30.171394 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:30.171577 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:30.171805 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:30.171806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:30.171806 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:30.171915 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:30.172167 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:30.172173 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:30.172291 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 14:40:30.172382 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:40:30.172495 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260808 14:40:30.173179 1673 heartbeater.cc:347] Connected to a master server at 127.29.168.254:38363
I20260808 14:40:30.173302 1673 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:30.173477 1673 heartbeater.cc:511] Master 127.29.168.254:38363 requested a full tablet report, sending...
I20260808 14:40:30.174032 1398 ts_manager.cc:194] Registered new tserver with Master: dfb8342847cc44878c27600036e1ce2f (127.29.168.193:44127)
I20260808 14:40:30.174129 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 1487
I20260808 14:40:30.174229 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:30.174417 30371 external_mini_cluster.cc:1428] Setting key ba7107f6536af18af9c6388dc247dc5d
I20260808 14:40:30.174760 1398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:34489
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:30.197760 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:38363
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:30.275610 1679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:30.275858 1679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:30.275892 1679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:30.276906 1679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:30.276962 1679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:30.276999 1679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:30.278260 1679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:38363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:30.278497 1679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:30.278707 1679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:30.283445 1686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:30.285873 1679 server_base.cc:1034] running on GCE node
W20260808 14:40:30.285928 1685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:30.285962 1690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:30.286227 1679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:30.286500 1679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:30.287703 1679 hybrid_clock.cc:648] HybridClock initialized: now 1786200030287691 us; error 40 us; skew 500 ppm
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[1339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200030, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:30.290134 1679 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:30.290568 1679 webserver.cc:460] Webserver started at http://127.29.168.194:42855/ using document root <none> and password file <none>
I20260808 14:40:30.290802 1679 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:30.290872 1679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:30.291004 1679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:30.292004 1679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "dec39a7488a649e5ad6107145bf473ce"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "67bad0d1537510defdc8a5c670db653a"
server_key_iv: "206556755a01ff38f13df026de0365c3"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.292367 1679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "dec39a7488a649e5ad6107145bf473ce"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "67bad0d1537510defdc8a5c670db653a"
server_key_iv: "206556755a01ff38f13df026de0365c3"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.293641 1679 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:30.294283 1698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.294447 1679 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:30.294535 1679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "dec39a7488a649e5ad6107145bf473ce"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "67bad0d1537510defdc8a5c670db653a"
server_key_iv: "206556755a01ff38f13df026de0365c3"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.294605 1679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:30.312028 1679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:30.313844 1679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:30.313993 1679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:30.314200 1679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:30.314481 1679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:30.314531 1679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.314565 1679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:30.314590 1679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.320192 1679 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:34153
I20260808 14:40:30.320236 1862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:34153 every 8 connection(s)
I20260808 14:40:30.320511 1679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:30.321864 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 1679
I20260808 14:40:30.321964 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:30.322165 30371 external_mini_cluster.cc:1428] Setting key 4d90fafb795f3af4d7e28fec5af14f10
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[1339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200030, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:30.329934 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:30.321123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:47639 (local address 127.29.168.254:38363)
0808 14:40:30.321194 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:30.321196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:30.321364 (+ 168us) server_negotiation.cc:407] Connection header received
0808 14:40:30.321862 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:30.321863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:30.321876 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:30.321931 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:30.323108 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.323615 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.324605 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.324807 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.324886 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:30.326954 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:30.326956 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:30.326956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:30.326964 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:30.328631 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:30.328994 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:30.328995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:30.328996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:30.329059 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:30.329294 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:30.329295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:30.329295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:30.329434 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:30.329508 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:30.329747 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 14:40:30.329831 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:40:30.329942 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:30.321071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:38363 (local address 127.29.168.194:47639)
0808 14:40:30.321218 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:30.321276 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:30.321760 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:30.321994 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:30.321997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:30.322755 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:30.323015 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:30.323021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.323750 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.323751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:30.324513 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:30.324515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.324893 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.324894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:30.325020 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:30.325548 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:30.325556 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:30.326862 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:30.328711 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:30.328717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:30.328719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:30.328920 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:30.329140 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:30.329140 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:30.329140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:30.329225 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:30.329504 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:30.329508 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:30.329600 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 14:40:30.329689 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:40:30.329793 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":89,"threads_started":1}
I20260808 14:40:30.330559 1864 heartbeater.cc:347] Connected to a master server at 127.29.168.254:38363
I20260808 14:40:30.330638 1864 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:30.330817 1864 heartbeater.cc:511] Master 127.29.168.254:38363 requested a full tablet report, sending...
I20260808 14:40:30.331252 1397 ts_manager.cc:194] Registered new tserver with Master: dec39a7488a649e5ad6107145bf473ce (127.29.168.194:34153)
I20260808 14:40:30.331614 1397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:47639
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:30.348604 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:38363
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:30.428514 1870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:30.428725 1870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:30.428763 1870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:30.429919 1870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:30.429981 1870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:30.430024 1870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:30.431370 1870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:38363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:30.431596 1870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:30.431829 1870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:30.436451 1881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:30.436498 1876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:30.436657 1870 server_base.cc:1034] running on GCE node
W20260808 14:40:30.436558 1877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:30.436892 1870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:30.437125 1870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:30.438277 1870 hybrid_clock.cc:648] HybridClock initialized: now 1786200030438257 us; error 30 us; skew 500 ppm
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[1339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200030, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:30.440866 1870 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:30.441299 1870 webserver.cc:460] Webserver started at http://127.29.168.195:34587/ using document root <none> and password file <none>
I20260808 14:40:30.441530 1870 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:30.441610 1870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:30.441759 1870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:30.442965 1870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "1119482e1c1647a2862281a17604ff84"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "4cb02b87aa24e986ecdde64c1b8db075"
server_key_iv: "de39955d9eb1b31a5a26d1ceae870456"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.443369 1870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "1119482e1c1647a2862281a17604ff84"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "4cb02b87aa24e986ecdde64c1b8db075"
server_key_iv: "de39955d9eb1b31a5a26d1ceae870456"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.444834 1870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:30.445571 1892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.445807 1870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:30.445914 1870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "1119482e1c1647a2862281a17604ff84"
format_stamp: "Formatted at 2026-08-08 14:40:30 on dist-test-slave-mjjr"
server_key: "4cb02b87aa24e986ecdde64c1b8db075"
server_key_iv: "de39955d9eb1b31a5a26d1ceae870456"
server_key_version: "encryptionkey@0"
I20260808 14:40:30.445998 1870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:30.457692 1870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:30.459841 1870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:30.459981 1870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:30.460187 1870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:30.460458 1870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:30.460507 1870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.460544 1870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:30.460570 1870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:30.467540 1870 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:38613
I20260808 14:40:30.467607 2050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:38613 every 8 connection(s)
I20260808 14:40:30.467964 1870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[1339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200030, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:30.473412 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 1870
I20260808 14:40:30.473510 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:30.473681 30371 external_mini_cluster.cc:1428] Setting key 669a01ad800ec3acc6f7cc6631a79a5f
I20260808 14:40:30.476570 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:30.468679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:54341 (local address 127.29.168.254:38363)
0808 14:40:30.468716 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:30.468719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:30.468980 (+ 261us) server_negotiation.cc:407] Connection header received
0808 14:40:30.469418 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:30.469419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:30.469427 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:30.469478 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:30.470268 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.470706 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.471553 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.471726 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.471776 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:30.473786 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:30.473788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:30.473789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:30.473796 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:30.475199 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:30.475601 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:30.475602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:30.475603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:30.475678 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:30.475934 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:30.475935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:30.475935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:30.476062 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:30.476130 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:30.476404 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:40:30.476489 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:40:30.476706 2056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:30.468629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:38363 (local address 127.29.168.195:54341)
0808 14:40:30.468823 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:30.468873 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:30.469341 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:30.469535 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:30.469538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:30.470026 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:30.470186 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:30.470190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.470778 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.470779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:30.471484 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:30.471486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:30.471794 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:30.471795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:30.471889 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:30.472286 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:30.472294 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:30.473688 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:30.475294 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:30.475300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:30.475302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:30.475514 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:30.475749 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:30.475750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:30.475750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:30.475867 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:30.476122 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:30.476128 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:30.476271 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:40:30.476366 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:40:30.476513 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
I20260808 14:40:30.477169 2051 heartbeater.cc:347] Connected to a master server at 127.29.168.254:38363
I20260808 14:40:30.477258 2051 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:30.477427 2051 heartbeater.cc:511] Master 127.29.168.254:38363 requested a full tablet report, sending...
I20260808 14:40:30.477769 1397 ts_manager.cc:194] Registered new tserver with Master: 1119482e1c1647a2862281a17604ff84 (127.29.168.195:38613)
I20260808 14:40:30.478080 1397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:54341
I20260808 14:40:30.485483 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:40:30.497571 1480 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:30.496742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.29.168.254:38363)
0808 14:40:30.496822 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:30.496824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:30.496914 (+ 90us) server_negotiation.cc:407] Connection header received
0808 14:40:30.496966 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:30.496966 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:30.496976 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:30.497027 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:30.497500 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51498: BlockingRecv error: recv got EOF from 127.0.0.1:51498 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:40:30.498586 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 1487
I20260808 14:40:30.509711 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 1679
I20260808 14:40:30.517246 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 1870
I20260808 14:40:30.529978 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 1358
2026-08-08T14:40:30Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1957 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[2068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[2068](info): set up 2 sockets
Aug 08 14:40:30 dist-test-slave-mjjr krb5kdc[2068](info): commencing operation
krb5kdc: starting...
W20260808 14:40:31.704723 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:31 dist-test-slave-mjjr krb5kdc[2068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:31.817577 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33563
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:33097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:31.897933 2086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:31.898113 2086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:31.898132 2086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:31.899250 2086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:31.899287 2086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:31.899302 2086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:31.899313 2086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:31.899364 2086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:31.900861 2086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:33097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:31.901091 2086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:31.901311 2086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:31.905933 2100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:31.905974 2086 server_base.cc:1034] running on GCE node
W20260808 14:40:31.905943 2096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:31.905946 2092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:31.906319 2086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:31.906615 2086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:31.907748 2086 hybrid_clock.cc:648] HybridClock initialized: now 1786200031907728 us; error 29 us; skew 500 ppm
Aug 08 14:40:31 dist-test-slave-mjjr krb5kdc[2068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200031, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:31.914392 2086 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:31.914817 2086 webserver.cc:460] Webserver started at http://127.29.168.254:44477/ using document root <none> and password file <none>
I20260808 14:40:31.915041 2086 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:31.915119 2086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:31.915280 2086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:31.916319 2086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "3ac03dec9ed14c45a33632c1abc23db4"
format_stamp: "Formatted at 2026-08-08 14:40:31 on dist-test-slave-mjjr"
server_key: "aba93ccd1e3458548aa108c5def89512"
server_key_iv: "6b667d4e3b8c020b6a5d5333b9451fc1"
server_key_version: "encryptionkey@0"
I20260808 14:40:31.916674 2086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "3ac03dec9ed14c45a33632c1abc23db4"
format_stamp: "Formatted at 2026-08-08 14:40:31 on dist-test-slave-mjjr"
server_key: "aba93ccd1e3458548aa108c5def89512"
server_key_iv: "6b667d4e3b8c020b6a5d5333b9451fc1"
server_key_version: "encryptionkey@0"
I20260808 14:40:31.917968 2086 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:31.918669 2108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:31.918839 2086 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:31.918941 2086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "3ac03dec9ed14c45a33632c1abc23db4"
format_stamp: "Formatted at 2026-08-08 14:40:31 on dist-test-slave-mjjr"
server_key: "aba93ccd1e3458548aa108c5def89512"
server_key_iv: "6b667d4e3b8c020b6a5d5333b9451fc1"
server_key_version: "encryptionkey@0"
I20260808 14:40:31.919008 2086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:31.929291 2086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:31.930820 2086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:31.930967 2086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:31.934934 2086 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33563
I20260808 14:40:31.934984 2177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33563 every 8 connection(s)
I20260808 14:40:31.935539 2086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:31.936221 2178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:31.938277 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4: Bootstrap starting.
I20260808 14:40:31.938860 2178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:31.939152 2178 log.cc:824] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:31.939810 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4: No bootstrap required, opened a new log
I20260808 14:40:31.941232 2178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac03dec9ed14c45a33632c1abc23db4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33563 } }
I20260808 14:40:31.941365 2178 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:31.941409 2178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac03dec9ed14c45a33632c1abc23db4, State: Initialized, Role: FOLLOWER
I20260808 14:40:31.941562 2178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac03dec9ed14c45a33632c1abc23db4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33563 } }
I20260808 14:40:31.941620 2178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:31.941640 2178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:31.941726 2178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:31.941851 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 2086
I20260808 14:40:31.941962 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:31.942132 30371 external_mini_cluster.cc:1428] Setting key 818316e7341e727ea08b22eff4d2bf38
I20260808 14:40:31.942845 2178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac03dec9ed14c45a33632c1abc23db4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33563 } }
I20260808 14:40:31.942934 2178 leader_election.cc:302] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ac03dec9ed14c45a33632c1abc23db4; no voters:
I20260808 14:40:31.943138 2178 leader_election.cc:288] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:31.943171 2183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:31.943356 2183 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [term 1 LEADER]: Becoming Leader. State: Replica: 3ac03dec9ed14c45a33632c1abc23db4, State: Running, Role: LEADER
I20260808 14:40:31.943501 2178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:31.943511 2183 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac03dec9ed14c45a33632c1abc23db4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33563 } }
I20260808 14:40:31.943944 2186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ac03dec9ed14c45a33632c1abc23db4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac03dec9ed14c45a33632c1abc23db4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33563 } } }
I20260808 14:40:31.944130 2184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ac03dec9ed14c45a33632c1abc23db4. Latest consensus state: current_term: 1 leader_uuid: "3ac03dec9ed14c45a33632c1abc23db4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac03dec9ed14c45a33632c1abc23db4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33563 } } }
I20260808 14:40:31.944208 2186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:31.944296 2184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4 [sys.catalog]: This master's current role is: LEADER
W20260808 14:40:31.945323 2210 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:31.945382 2210 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:31.945428 2195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:31.945574 2195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:31.947448 2195 catalog_manager.cc:1347] Generated new cluster ID: 8034a98e54e44755b8b018b3d2a3e4ac
I20260808 14:40:31.947510 2195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:31 dist-test-slave-mjjr krb5kdc[2068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:31.953055 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:31.942607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47638 (local address 127.29.168.254:33563)
0808 14:40:31.942779 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:31.942789 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:31.942823 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:40:31.942958 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:31.942965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:31.943021 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:31.943159 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:31.943947 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:31.945147 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:31.946050 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:31.946664 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:31.946783 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:31.949561 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:31.949565 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:31.949566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:31.949576 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:31.951377 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:31.951834 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:31.951837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:31.951837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:31.951950 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:31.952170 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:31.952170 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:31.952171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:31.952466 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:31.952614 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:31.952722 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 14:40:31.952849 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260808 14:40:31.954015 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:31.962822 2195 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:31.963315 2195 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:31.975555 2195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ac03dec9ed14c45a33632c1abc23db4: Generated new TSK 0
I20260808 14:40:31.975761 2195 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:31.981714 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:31.978227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.29.168.254:33563)
0808 14:40:31.978284 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:31.978286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:31.978399 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:40:31.978452 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:31.978453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:31.978462 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:31.978508 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:31.978890 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:31.979387 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:31.980411 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:31.980577 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:31.980623 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:31.981259 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:31.981260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:31.981260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:31.981436 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:31.981450 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:31.981456 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:31.981518 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:31.981607 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 14:40:31.981628 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:31.984129 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 2086
2026-08-08T14:40:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1464 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:32 dist-test-slave-mjjr krb5kdc[2228](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:32 dist-test-slave-mjjr krb5kdc[2228](info): set up 2 sockets
Aug 08 14:40:32 dist-test-slave-mjjr krb5kdc[2228](info): commencing operation
krb5kdc: starting...
W20260808 14:40:33.169768 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:33.280406 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45335
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:45335
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:33.360651 2251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:33.360863 2251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:33.360884 2251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:33.361989 2251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:33.362026 2251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:33.362039 2251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:33.362051 2251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:33.362061 2251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:33.363550 2251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:45335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:33.363824 2251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:33.364030 2251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:33.368649 2258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.368661 2262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.368661 2257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:33.368978 2251 server_base.cc:1034] running on GCE node
I20260808 14:40:33.369218 2251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:33.369490 2251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:33.370645 2251 hybrid_clock.cc:648] HybridClock initialized: now 1786200033370633 us; error 39 us; skew 500 ppm
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:33.373093 2251 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:33.373570 2251 webserver.cc:460] Webserver started at http://127.29.168.254:33391/ using document root <none> and password file <none>
I20260808 14:40:33.373785 2251 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:33.373850 2251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:33.373996 2251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:33.374993 2251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "851bb353a6a645ffbecdfc75b3de4b84"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "94304650907b650630649bef05586430"
server_key_iv: "98335a5a5cd28039a745a17f9fb179ff"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.375362 2251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "851bb353a6a645ffbecdfc75b3de4b84"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "94304650907b650630649bef05586430"
server_key_iv: "98335a5a5cd28039a745a17f9fb179ff"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.376726 2251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:33.377509 2272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.377692 2251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:33.377818 2251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "851bb353a6a645ffbecdfc75b3de4b84"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "94304650907b650630649bef05586430"
server_key_iv: "98335a5a5cd28039a745a17f9fb179ff"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.377897 2251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:33.387122 2251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:33.388979 2251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:33.389122 2251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:33.393155 2251 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:45335
I20260808 14:40:33.393186 2340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:45335 every 8 connection(s)
I20260808 14:40:33.393518 2251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:33.394629 2341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:33.394623 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 2251
I20260808 14:40:33.394711 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:33.394904 30371 external_mini_cluster.cc:1428] Setting key be1a6c7aba514f2c1a4eb1c52f724e1a
I20260808 14:40:33.397680 2341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84: Bootstrap starting.
I20260808 14:40:33.398360 2341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:33.398656 2341 log.cc:824] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:33.399328 2341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84: No bootstrap required, opened a new log
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:33.401723 2341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851bb353a6a645ffbecdfc75b3de4b84" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45335 } }
I20260808 14:40:33.401870 2341 raft_consensus.cc:374] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:33.401911 2341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 851bb353a6a645ffbecdfc75b3de4b84, State: Initialized, Role: FOLLOWER
I20260808 14:40:33.402025 2341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851bb353a6a645ffbecdfc75b3de4b84" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45335 } }
I20260808 14:40:33.402129 2341 raft_consensus.cc:388] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:33.402163 2341 raft_consensus.cc:482] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:33.402210 2341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:33.402858 2341 raft_consensus.cc:504] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851bb353a6a645ffbecdfc75b3de4b84" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45335 } }
I20260808 14:40:33.402992 2341 leader_election.cc:302] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 851bb353a6a645ffbecdfc75b3de4b84; no voters:
I20260808 14:40:33.403167 2341 leader_election.cc:288] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:33.403214 2349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:33.403340 2349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [term 1 LEADER]: Becoming Leader. State: Replica: 851bb353a6a645ffbecdfc75b3de4b84, State: Running, Role: LEADER
I20260808 14:40:33.403479 2349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851bb353a6a645ffbecdfc75b3de4b84" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45335 } }
I20260808 14:40:33.403522 2341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:33.403816 2349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 851bb353a6a645ffbecdfc75b3de4b84. Latest consensus state: current_term: 1 leader_uuid: "851bb353a6a645ffbecdfc75b3de4b84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851bb353a6a645ffbecdfc75b3de4b84" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45335 } } }
I20260808 14:40:33.404042 2349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:33.403966 2352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "851bb353a6a645ffbecdfc75b3de4b84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851bb353a6a645ffbecdfc75b3de4b84" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45335 } } }
I20260808 14:40:33.404452 2352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:33.404688 2362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:33.405231 2362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:33.406006 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.395420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58340 (local address 127.29.168.254:45335)
0808 14:40:33.395578 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:33.395584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:33.395606 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:40:33.396121 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:33.396127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:33.396168 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:33.396295 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:33.397009 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.397824 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.398809 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.399162 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.399233 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.401814 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:33.401818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:33.401818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:33.401827 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:33.403989 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.404429 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.404431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.404432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.404556 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.404786 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.404787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.404787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.405178 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:33.405367 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:33.405697 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 14:40:33.405813 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260808 14:40:33.406765 2362 catalog_manager.cc:1347] Generated new cluster ID: b194c5b5eee34a9a893158bec886c778
I20260808 14:40:33.406844 2362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:33.415813 2362 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:33.416431 2362 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:33.431571 2362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 851bb353a6a645ffbecdfc75b3de4b84: Generated new TSK 0
I20260808 14:40:33.431735 2362 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:33.458554 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45335
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:33.537539 2384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:33.537756 2384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:33.537792 2384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:33.538833 2384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:33.538901 2384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:33.538945 2384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:33.540292 2384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:33.540539 2384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:33.540761 2384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:33.545614 2389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.545666 2390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.545666 2392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:33.545694 2384 server_base.cc:1034] running on GCE node
I20260808 14:40:33.547914 2384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:33.548126 2384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:33.549307 2384 hybrid_clock.cc:648] HybridClock initialized: now 1786200033549289 us; error 27 us; skew 500 ppm
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:33.551578 2384 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:33.551987 2384 webserver.cc:460] Webserver started at http://127.29.168.193:37181/ using document root <none> and password file <none>
I20260808 14:40:33.552191 2384 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:33.552253 2384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:33.552433 2384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:33.553390 2384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "04f4967cf3424203955fc73d5c54c8c8"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "a77d6c34dc042cec182f9080b6bb21a0"
server_key_iv: "7ce07b24da067c5d9b81dc6368df502f"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.553754 2384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "04f4967cf3424203955fc73d5c54c8c8"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "a77d6c34dc042cec182f9080b6bb21a0"
server_key_iv: "7ce07b24da067c5d9b81dc6368df502f"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.555022 2384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:33.555758 2400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.555922 2384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:33.556020 2384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "04f4967cf3424203955fc73d5c54c8c8"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "a77d6c34dc042cec182f9080b6bb21a0"
server_key_iv: "7ce07b24da067c5d9b81dc6368df502f"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.556104 2384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:33.572495 2384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:33.574182 2384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:33.574328 2384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:33.574528 2384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:33.574813 2384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:33.574877 2384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.574926 2384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:33.574951 2384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.581125 2384 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:35655
I20260808 14:40:33.581187 2568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:35655 every 8 connection(s)
I20260808 14:40:33.581485 2384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:33.582938 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 2384
I20260808 14:40:33.583045 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:33.583289 30371 external_mini_cluster.cc:1428] Setting key 8d57461ef62e06c63205baaa9c910b8a
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:33.591243 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.582150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:47503 (local address 127.29.168.254:45335)
0808 14:40:33.582218 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:33.582220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:33.582394 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:40:33.582849 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:33.582849 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:33.582859 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:33.582902 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:33.584159 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.584618 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.586029 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.586261 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.586374 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.588470 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:33.588471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:33.588472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:33.588481 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:33.589884 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.590340 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.590341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.590341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.590389 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.590662 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.590662 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.590662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.590756 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:33.590803 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:33.591120 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 14:40:33.591182 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:40:33.591557 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.582111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45335 (local address 127.29.168.193:47503)
0808 14:40:33.582259 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:33.582288 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:33.582720 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:33.582973 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:33.582978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:33.583831 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:33.584073 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:33.584079 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.584709 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.584710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:33.585940 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:33.585943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.586388 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.586389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:33.586532 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.587003 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:33.587011 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:33.588376 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:33.589964 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:33.589972 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:33.589974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:33.590255 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:33.590445 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:33.590446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:33.590446 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:33.590595 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:33.590823 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:33.590830 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:33.590982 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 14:40:33.591103 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:40:33.591260 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260808 14:40:33.592114 2570 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45335
I20260808 14:40:33.592201 2570 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:33.592391 2570 heartbeater.cc:511] Master 127.29.168.254:45335 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
I20260808 14:40:33.592919 2297 ts_manager.cc:194] Registered new tserver with Master: 04f4967cf3424203955fc73d5c54c8c8 (127.29.168.193:35655)
I20260808 14:40:33.593623 2297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:47503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:33.609568 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45335
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:33.686043 2580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:33.686213 2580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:33.686234 2580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:33.687294 2580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:33.687331 2580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:33.687357 2580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:33.688652 2580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:33.688814 2580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:33.688962 2580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:40:33.693667 2580 server_base.cc:1034] running on GCE node
W20260808 14:40:33.693555 2591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.693560 2587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.693557 2586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:33.694025 2580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:33.694259 2580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:33.695418 2580 hybrid_clock.cc:648] HybridClock initialized: now 1786200033695423 us; error 46 us; skew 500 ppm
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:33.697865 2580 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:33.698240 2580 webserver.cc:460] Webserver started at http://127.29.168.194:35441/ using document root <none> and password file <none>
I20260808 14:40:33.698452 2580 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:33.698513 2580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:33.698652 2580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:33.699536 2580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "b7b2d1948d0f423da75e9f003c37903f"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "787caacfb79183e3a6977638543d382d"
server_key_iv: "166642c8e82c8035ae609f32814286ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.699879 2580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "b7b2d1948d0f423da75e9f003c37903f"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "787caacfb79183e3a6977638543d382d"
server_key_iv: "166642c8e82c8035ae609f32814286ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.701063 2580 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:33.701767 2602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.701951 2580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:33.702041 2580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "b7b2d1948d0f423da75e9f003c37903f"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "787caacfb79183e3a6977638543d382d"
server_key_iv: "166642c8e82c8035ae609f32814286ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.702126 2580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:33.717411 2580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:33.719421 2580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:33.719563 2580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:33.719826 2580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:33.720093 2580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:33.720160 2580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.720191 2580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:33.720216 2580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.725826 2580 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:44639
I20260808 14:40:33.725864 2770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:44639 every 8 connection(s)
I20260808 14:40:33.726145 2580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:33.733767 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 2580
I20260808 14:40:33.733915 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:33.734143 30371 external_mini_cluster.cc:1428] Setting key 525680e59dbba9c98cbd5c127e171207
I20260808 14:40:33.734665 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.726916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:44961 (local address 127.29.168.254:45335)
0808 14:40:33.726977 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:33.726995 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:33.727181 (+ 186us) server_negotiation.cc:407] Connection header received
0808 14:40:33.727682 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:33.727684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:33.727696 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:33.727754 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:33.728539 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.728967 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.729869 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.730048 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.730119 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.731997 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:33.731998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:33.731998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:33.732004 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:33.733202 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.733628 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.733630 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.733631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.733705 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.734002 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.734003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.734003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.734154 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:33.734228 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:33.734541 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 14:40:33.734607 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:40:33.734877 2774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.726876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45335 (local address 127.29.168.194:44961)
0808 14:40:33.727057 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:33.727099 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:33.727551 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:33.727824 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:33.727827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:33.728298 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:33.728449 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:33.728453 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.729054 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.729054 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:33.729760 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:33.729762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.730125 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.730126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:33.730241 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.730636 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:33.730644 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:33.731912 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:33.733287 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:33.733294 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:33.733296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:33.733512 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:33.733772 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:33.733773 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:33.733773 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:33.733865 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:33.734226 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:33.734232 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:33.734401 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:40:33.734526 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:40:33.734670 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260808 14:40:33.735349 2771 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45335
I20260808 14:40:33.735447 2771 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:33.735601 2771 heartbeater.cc:511] Master 127.29.168.254:45335 requested a full tablet report, sending...
I20260808 14:40:33.736027 2297 ts_manager.cc:194] Registered new tserver with Master: b7b2d1948d0f423da75e9f003c37903f (127.29.168.194:44639)
I20260808 14:40:33.736332 2297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:44961
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:33.758224 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45335
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:33.834492 2779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:33.834703 2779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:33.834738 2779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:33.835898 2779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:33.835952 2779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:33.835992 2779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:33.837431 2779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:33.837688 2779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:33.837903 2779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:33.842450 2791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:33.842585 2789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:33.842644 2779 server_base.cc:1034] running on GCE node
W20260808 14:40:33.842585 2787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:33.843108 2779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:33.843348 2779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:33.844513 2779 hybrid_clock.cc:648] HybridClock initialized: now 1786200033844505 us; error 41 us; skew 500 ppm
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:33.847018 2779 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:33.847493 2779 webserver.cc:460] Webserver started at http://127.29.168.195:37837/ using document root <none> and password file <none>
I20260808 14:40:33.847797 2779 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:33.847863 2779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:33.848006 2779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:33.848886 2779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "b76e813fe72249e2a8811495bef9f557"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "e792694d5667e6a676f5a87972f91f4a"
server_key_iv: "c17926378e30fd4620461b6865612f74"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.849231 2779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "b76e813fe72249e2a8811495bef9f557"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "e792694d5667e6a676f5a87972f91f4a"
server_key_iv: "c17926378e30fd4620461b6865612f74"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.850476 2779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:33.851120 2802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.851271 2779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:33.851362 2779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "b76e813fe72249e2a8811495bef9f557"
format_stamp: "Formatted at 2026-08-08 14:40:33 on dist-test-slave-mjjr"
server_key: "e792694d5667e6a676f5a87972f91f4a"
server_key_iv: "c17926378e30fd4620461b6865612f74"
server_key_version: "encryptionkey@0"
I20260808 14:40:33.851436 2779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:33.863444 2779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:33.865828 2779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:33.866004 2779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:33.866278 2779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:33.866670 2779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:33.866719 2779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.866758 2779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:33.866783 2779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:33.874325 2779 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:37103
I20260808 14:40:33.874653 2779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:33.879150 2964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:37103 every 8 connection(s)
I20260808 14:40:33.882588 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 2779
I20260808 14:40:33.882691 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:33.882880 30371 external_mini_cluster.cc:1428] Setting key cdb843677c4dcc8c5cdf825358d33560
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:33.888703 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.879762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:38529 (local address 127.29.168.254:45335)
0808 14:40:33.879816 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:33.879818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:33.880047 (+ 229us) server_negotiation.cc:407] Connection header received
0808 14:40:33.880616 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:33.880617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:33.880629 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:33.880712 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:33.881828 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.882513 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.883944 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.884151 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.884226 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.886163 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:33.886165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:33.886165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:33.886173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:33.887336 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.887807 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.887809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.887809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.887865 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.888107 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.888107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.888108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.888214 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:33.888277 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:33.888525 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 14:40:33.888621 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:40:33.888846 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.879781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45335 (local address 127.29.168.195:38529)
0808 14:40:33.879932 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:33.879974 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:33.880514 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:33.880812 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:33.880817 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:33.881543 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:33.881728 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:33.881733 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.882614 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.882615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:33.883844 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:33.883847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.884233 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.884234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:33.884356 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.884730 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:33.884737 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:33.886067 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:33.887422 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:33.887430 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:33.887432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:33.887739 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:33.887937 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:33.887938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:33.887938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:33.888041 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:33.888280 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:33.888287 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:33.888404 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:40:33.888491 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:40:33.888643 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260808 14:40:33.889211 2965 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45335
I20260808 14:40:33.889281 2965 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:33.889451 2965 heartbeater.cc:511] Master 127.29.168.254:45335 requested a full tablet report, sending...
I20260808 14:40:33.889757 2297 ts_manager.cc:194] Registered new tserver with Master: b76e813fe72249e2a8811495bef9f557 (127.29.168.195:37103)
I20260808 14:40:33.890208 2297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:38529
I20260808 14:40:33.894636 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 14:40:33 dist-test-slave-mjjr krb5kdc[2228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200033, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:33.917407 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:33.910914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58352 (local address 127.29.168.254:45335)
0808 14:40:33.910951 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:33.910953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:33.911014 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:40:33.911063 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:33.911064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:33.911071 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:33.911123 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:33.911605 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.912096 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.912810 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:33.912987 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:33.913041 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:33.915161 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:33.915163 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:33.915163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:33.915169 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:33.916416 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.916779 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.916780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.916781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.916826 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:33.916986 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:33.916987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:33.916987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:33.917124 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:33.917217 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:33.917298 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:40:33.917350 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 14:40:33.917656 2297 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58352
I20260808 14:40:33.918138 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 2384
I20260808 14:40:33.933861 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 2580
I20260808 14:40:33.941725 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 2779
I20260808 14:40:33.967617 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 2251
2026-08-08T14:40:33Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1972 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:34 dist-test-slave-mjjr krb5kdc[2981](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:34 dist-test-slave-mjjr krb5kdc[2981](info): set up 2 sockets
Aug 08 14:40:34 dist-test-slave-mjjr krb5kdc[2981](info): commencing operation
krb5kdc: starting...
W20260808 14:40:35.164438 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:35.278757 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43711
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:43711
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:35.356788 3002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:35.357007 3002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:35.357043 3002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:35.358124 3002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:35.358187 3002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:35.358209 3002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:35.358230 3002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:35.358258 3002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:35.359704 3002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:43711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:35.359943 3002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:35.360146 3002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:35.364676 3009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.364686 3014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.364709 3007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:35.364771 3002 server_base.cc:1034] running on GCE node
I20260808 14:40:35.365180 3002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:35.365417 3002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:35.366595 3002 hybrid_clock.cc:648] HybridClock initialized: now 1786200035366581 us; error 40 us; skew 500 ppm
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:35.369063 3002 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:35.369499 3002 webserver.cc:460] Webserver started at http://127.29.168.254:39589/ using document root <none> and password file <none>
I20260808 14:40:35.369691 3002 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:35.369747 3002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:35.369879 3002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:35.370766 3002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "39068c035868458fbd7747e13bcb9e18"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "e3228720ee6c55d54bd7136ea3420aa5"
server_key_iv: "2ecf0881b1ddecb9017ded87a7af05ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.371146 3002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "39068c035868458fbd7747e13bcb9e18"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "e3228720ee6c55d54bd7136ea3420aa5"
server_key_iv: "2ecf0881b1ddecb9017ded87a7af05ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.372529 3002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:35.373310 3024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.373500 3002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:35.373605 3002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "39068c035868458fbd7747e13bcb9e18"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "e3228720ee6c55d54bd7136ea3420aa5"
server_key_iv: "2ecf0881b1ddecb9017ded87a7af05ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.373690 3002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:35.383414 3002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:35.385659 3002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:35.385839 3002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:35.390136 3002 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:43711
I20260808 14:40:35.390166 3103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:43711 every 8 connection(s)
I20260808 14:40:35.390632 3002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:35.391309 3104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:35.392747 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 3002
I20260808 14:40:35.392860 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:35.393049 30371 external_mini_cluster.cc:1428] Setting key c908ad0ac4467fff61fd39448968208f
I20260808 14:40:35.393940 3104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18: Bootstrap starting.
I20260808 14:40:35.394614 3104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:35.394906 3104 log.cc:824] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:35.395550 3104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18: No bootstrap required, opened a new log
I20260808 14:40:35.397293 3104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39068c035868458fbd7747e13bcb9e18" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43711 } }
I20260808 14:40:35.397428 3104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:35.397469 3104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39068c035868458fbd7747e13bcb9e18, State: Initialized, Role: FOLLOWER
I20260808 14:40:35.397574 3104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39068c035868458fbd7747e13bcb9e18" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43711 } }
I20260808 14:40:35.397642 3104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:35.397679 3104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:35.397727 3104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:35.398203 3104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39068c035868458fbd7747e13bcb9e18" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43711 } }
I20260808 14:40:35.398325 3104 leader_election.cc:302] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39068c035868458fbd7747e13bcb9e18; no voters:
I20260808 14:40:35.398505 3104 leader_election.cc:288] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:35.398530 3111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:35.398646 3111 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [term 1 LEADER]: Becoming Leader. State: Replica: 39068c035868458fbd7747e13bcb9e18, State: Running, Role: LEADER
I20260808 14:40:35.398725 3111 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39068c035868458fbd7747e13bcb9e18" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43711 } }
I20260808 14:40:35.398754 3104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:35.399036 3111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39068c035868458fbd7747e13bcb9e18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39068c035868458fbd7747e13bcb9e18" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43711 } } }
I20260808 14:40:35.399093 3111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [sys.catalog]: This master's current role is: LEADER
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:35.399206 3111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39068c035868458fbd7747e13bcb9e18. Latest consensus state: current_term: 1 leader_uuid: "39068c035868458fbd7747e13bcb9e18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39068c035868458fbd7747e13bcb9e18" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43711 } } }
I20260808 14:40:35.399258 3111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:35.400049 3117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:35.400521 3117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:35.402176 3117 catalog_manager.cc:1347] Generated new cluster ID: 404e0c6c36a74f81829fbecbf7053698
I20260808 14:40:35.402242 3117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:35.403704 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.393558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58582 (local address 127.29.168.254:43711)
0808 14:40:35.393796 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:35.393804 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:35.393835 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:40:35.394349 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:35.394357 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:35.394409 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:35.394564 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:35.395196 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.396089 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.396808 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.397176 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.397303 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.399926 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:35.399929 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:35.399930 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:35.399943 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:35.402011 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.402474 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.402476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.402477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.402572 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.402804 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.402804 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.402805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.403076 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:35.403209 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:35.403358 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:40:35.403479 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":77,"threads_started":1}
I20260808 14:40:35.410080 3117 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:35.410527 3117 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:35.415534 3117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39068c035868458fbd7747e13bcb9e18: Generated new TSK 0
I20260808 14:40:35.415730 3117 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:35.444164 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43711
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:35.523509 3140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:35.523727 3140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:35.523762 3140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:35.524771 3140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:35.524806 3140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:35.524835 3140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:35.526279 3140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43711
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:35.526453 3140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:35.526633 3140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:35.531378 3146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.531407 3150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:35.531500 3140 server_base.cc:1034] running on GCE node
W20260808 14:40:35.531693 3152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:35.531966 3140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:35.532194 3140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:35.533353 3140 hybrid_clock.cc:648] HybridClock initialized: now 1786200035533354 us; error 37 us; skew 500 ppm
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:35.535801 3140 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:35.536216 3140 webserver.cc:460] Webserver started at http://127.29.168.193:40609/ using document root <none> and password file <none>
I20260808 14:40:35.536449 3140 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:35.536520 3140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:35.536653 3140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:35.537616 3140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "fc9b93f865c64f248ad5efcdbd3561c8"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "c69363d06529a68b434b4e309fb2f945"
server_key_iv: "55d1b565c989f7b0f79a3709f312b40a"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.537966 3140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "fc9b93f865c64f248ad5efcdbd3561c8"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "c69363d06529a68b434b4e309fb2f945"
server_key_iv: "55d1b565c989f7b0f79a3709f312b40a"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.539198 3140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:40:35.539949 3161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.540104 3140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:35.540198 3140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "fc9b93f865c64f248ad5efcdbd3561c8"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "c69363d06529a68b434b4e309fb2f945"
server_key_iv: "55d1b565c989f7b0f79a3709f312b40a"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.540282 3140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:35.550681 3140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:35.552775 3140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:35.552947 3140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:35.553169 3140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:35.553467 3140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:35.553524 3140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.553558 3140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:35.553586 3140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.559257 3140 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:46369
I20260808 14:40:35.559325 3332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:46369 every 8 connection(s)
I20260808 14:40:35.559619 3140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:35.567808 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.560336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:44733 (local address 127.29.168.254:43711)
0808 14:40:35.560394 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:35.560395 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:35.560547 (+ 152us) server_negotiation.cc:407] Connection header received
0808 14:40:35.561369 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:35.561370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:35.561380 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:35.561440 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:35.561927 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.562385 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.563315 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.563504 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.563553 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.565510 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:35.565511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:35.565512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:35.565518 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:35.566609 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.566998 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.566998 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.566999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.567048 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.567255 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.567255 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.567256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.567355 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:35.567404 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:35.567619 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 14:40:35.567745 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:35.567920 3335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.560298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:43711 (local address 127.29.168.193:44733)
0808 14:40:35.560438 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:35.560474 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:35.561278 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:35.561485 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:35.561488 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:35.561693 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:35.561862 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:35.561866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.562456 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.562457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:35.563243 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:35.563244 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.563578 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.563578 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:35.563698 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.564227 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:35.564235 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:35.565415 (+ 1180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:35.566683 (+ 1268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:35.566691 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:35.566693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:35.566922 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:35.567108 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:35.567108 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:35.567108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:35.567201 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:35.567410 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:35.567415 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:35.567513 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 14:40:35.567592 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:40:35.567723 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":76,"threads_started":1}
I20260808 14:40:35.568411 3333 heartbeater.cc:347] Connected to a master server at 127.29.168.254:43711
I20260808 14:40:35.568516 3333 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:35.568643 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 3140
I20260808 14:40:35.568709 3333 heartbeater.cc:511] Master 127.29.168.254:43711 requested a full tablet report, sending...
I20260808 14:40:35.568747 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:35.568986 30371 external_mini_cluster.cc:1428] Setting key ecb949fa4f038ca16961641ab598d36f
I20260808 14:40:35.569258 3054 ts_manager.cc:194] Registered new tserver with Master: fc9b93f865c64f248ad5efcdbd3561c8 (127.29.168.193:46369)
I20260808 14:40:35.569967 3054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:44733
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:35.592432 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43711
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:35.671481 3342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:35.671675 3342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:35.671698 3342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:35.672787 3342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:35.672829 3342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:35.672856 3342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:35.674273 3342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43711
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:35.674468 3342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:35.674640 3342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:35.679394 3356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.679479 3353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.679375 3352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:35.679625 3342 server_base.cc:1034] running on GCE node
I20260808 14:40:35.679831 3342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:35.680006 3342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:35.681201 3342 hybrid_clock.cc:648] HybridClock initialized: now 1786200035681177 us; error 39 us; skew 500 ppm
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:35.683820 3342 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:35.684207 3342 webserver.cc:460] Webserver started at http://127.29.168.194:39871/ using document root <none> and password file <none>
I20260808 14:40:35.684443 3342 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:35.684510 3342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:35.684659 3342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:35.685621 3342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "42db511ac27044a4a71424102369afe0"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "a37f407a4ecc02d360d1f593560ad58f"
server_key_iv: "bbde094f37ce876c58d437584c1c4c98"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.685967 3342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "42db511ac27044a4a71424102369afe0"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "a37f407a4ecc02d360d1f593560ad58f"
server_key_iv: "bbde094f37ce876c58d437584c1c4c98"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.687597 3342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 14:40:35.688388 3366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.688575 3342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:35.688678 3342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "42db511ac27044a4a71424102369afe0"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "a37f407a4ecc02d360d1f593560ad58f"
server_key_iv: "bbde094f37ce876c58d437584c1c4c98"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.688750 3342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:35.698117 3342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:35.700351 3342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:35.700511 3342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:35.700737 3342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:35.701020 3342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:35.701076 3342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.701113 3342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:35.701138 3342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.707201 3342 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:46855
I20260808 14:40:35.707238 3526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:46855 every 8 connection(s)
I20260808 14:40:35.707540 3342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:35.715865 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.708315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:36141 (local address 127.29.168.254:43711)
0808 14:40:35.708387 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:35.708390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:35.708503 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:40:35.709310 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:35.709311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:35.709322 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:35.709376 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:35.709911 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.710390 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.711257 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.711421 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.711466 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.713396 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:35.713398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:35.713398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:35.713405 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:35.714774 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.715090 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.715091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.715092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.715148 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.715333 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.715333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.715333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.715422 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:35.715467 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:35.715750 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 14:40:35.715808 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:40:35.715919 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.708265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:43711 (local address 127.29.168.194:36141)
0808 14:40:35.708408 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:35.708438 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:35.709205 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:35.709445 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:35.709447 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:35.709662 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:35.709834 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:35.709838 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.710464 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.710464 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:35.711183 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:35.711185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.711487 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.711488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:35.711575 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.712007 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:35.712014 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:35.713301 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:35.714838 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:35.714843 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:35.714844 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:35.715026 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:35.715199 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:35.715199 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:35.715199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:35.715283 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:35.715470 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:35.715474 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:35.715565 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 14:40:35.715673 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:40:35.715790 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":86,"threads_started":1}
I20260808 14:40:35.716393 3527 heartbeater.cc:347] Connected to a master server at 127.29.168.254:43711
I20260808 14:40:35.716468 3527 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:35.716639 3527 heartbeater.cc:511] Master 127.29.168.254:43711 requested a full tablet report, sending...
I20260808 14:40:35.716995 3054 ts_manager.cc:194] Registered new tserver with Master: 42db511ac27044a4a71424102369afe0 (127.29.168.194:46855)
I20260808 14:40:35.717147 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 3342
I20260808 14:40:35.717255 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:35.717398 30371 external_mini_cluster.cc:1428] Setting key 89556a5064e628f94afbdfb97c20ffa5
I20260808 14:40:35.717427 3054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:36141
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:35.741566 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43711
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:35.818543 3532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:35.818737 3532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:35.818766 3532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:35.819999 3532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:35.820077 3532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:35.820134 3532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:35.821683 3532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43711
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:35.821992 3532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:35.822242 3532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:35.826963 3548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.826967 3543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:35.826972 3542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:35.827196 3532 server_base.cc:1034] running on GCE node
I20260808 14:40:35.827411 3532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:35.827703 3532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:35.828879 3532 hybrid_clock.cc:648] HybridClock initialized: now 1786200035828854 us; error 53 us; skew 500 ppm
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:35.831390 3532 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:35.831864 3532 webserver.cc:460] Webserver started at http://127.29.168.195:33059/ using document root <none> and password file <none>
I20260808 14:40:35.832098 3532 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:35.832166 3532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:35.832297 3532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:35.833266 3532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "795cdf5da1254ab9aa4eb45d7ba69fe4"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "5c456247aa380a175bd01e280e6a5475"
server_key_iv: "6c846ef271d33a94cf530208f62095ad"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.833627 3532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "795cdf5da1254ab9aa4eb45d7ba69fe4"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "5c456247aa380a175bd01e280e6a5475"
server_key_iv: "6c846ef271d33a94cf530208f62095ad"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.834973 3532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:35.835690 3558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.835875 3532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:35.835971 3532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "795cdf5da1254ab9aa4eb45d7ba69fe4"
format_stamp: "Formatted at 2026-08-08 14:40:35 on dist-test-slave-mjjr"
server_key: "5c456247aa380a175bd01e280e6a5475"
server_key_iv: "6c846ef271d33a94cf530208f62095ad"
server_key_version: "encryptionkey@0"
I20260808 14:40:35.836050 3532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:35.848664 3532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:35.850405 3532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:35.850567 3532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:35.850795 3532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:35.851153 3532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:35.851212 3532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.851246 3532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:35.851275 3532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:35.857656 3532 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:43987
I20260808 14:40:35.857695 3715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:43987 every 8 connection(s)
I20260808 14:40:35.858021 3532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:35.866154 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 3532
I20260808 14:40:35.866291 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:35.866556 30371 external_mini_cluster.cc:1428] Setting key 766f486d8012203d71fa340224407e5f
I20260808 14:40:35.868080 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.858741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:51937 (local address 127.29.168.254:43711)
0808 14:40:35.858844 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:35.858846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:35.859003 (+ 157us) server_negotiation.cc:407] Connection header received
0808 14:40:35.859868 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:35.859869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:35.859881 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:35.859925 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:35.860460 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.860931 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.861815 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.861989 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.862057 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.864037 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:35.864039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:35.864039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:35.864046 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:35.865897 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.866685 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.866687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.866687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.866762 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.867115 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.867117 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.867117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.867288 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:35.867371 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:35.867895 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 14:40:35.867992 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:40:35.868204 3718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.858686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:43711 (local address 127.29.168.195:51937)
0808 14:40:35.858868 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:35.858925 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:35.859766 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:35.859991 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:35.859994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:35.860212 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:35.860368 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:35.860372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.861021 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.861022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:35.861710 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:35.861712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.862064 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.862065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:35.862173 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.862618 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:35.862626 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:35.863945 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:35.866012 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:35.866020 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:35.866023 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:35.866541 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:35.866858 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:35.866858 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:35.866859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:35.867000 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:35.867387 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:35.867393 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:35.867584 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 14:40:35.867837 (+ 253us) client_negotiation.cc:240] Negotiation successful
0808 14:40:35.867995 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":85,"threads_started":1}
I20260808 14:40:35.869042 3716 heartbeater.cc:347] Connected to a master server at 127.29.168.254:43711
I20260808 14:40:35.869128 3716 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:35.869297 3716 heartbeater.cc:511] Master 127.29.168.254:43711 requested a full tablet report, sending...
I20260808 14:40:35.869661 3054 ts_manager.cc:194] Registered new tserver with Master: 795cdf5da1254ab9aa4eb45d7ba69fe4 (127.29.168.195:43987)
I20260808 14:40:35.870079 3054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:51937
I20260808 14:40:35.878243 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:35.902643 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.894611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40774 (local address 127.29.168.193:46369)
0808 14:40:35.894790 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:35.894794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:35.894804 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:35.894829 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:35.894831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:35.894844 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:35.894921 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:35.895559 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.896379 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.897077 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.897356 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.897402 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.900021 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:35.900032 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:35.900032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:35.900047 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:35.901660 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.901987 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.901989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.901989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.902040 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.902204 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.902205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.902205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.902320 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:35.902413 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:35.902491 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:40:35.902551 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
Aug 08 14:40:35 dist-test-slave-mjjr krb5kdc[2981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:35.910351 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:35.904018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38836 (local address 127.29.168.254:43711)
0808 14:40:35.904093 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:35.904095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:35.904141 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:40:35.904201 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:35.904202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:35.904211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:35.904267 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:35.904735 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.905211 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.905836 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:35.906010 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:35.906069 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:35.908251 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:35.908253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:35.908253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:35.908260 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:35.909270 (+ 1010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.909607 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.909608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.909608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.909658 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:35.909880 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:35.909880 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:35.909881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:35.910008 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:35.910102 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:35.910184 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:40:35.910255 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 14:40:35.910530 3054 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38836
I20260808 14:40:35.910826 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 3140
I20260808 14:40:35.935153 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 3342
I20260808 14:40:35.952986 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 3532
I20260808 14:40:35.962919 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 3002
2026-08-08T14:40:35Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1997 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:36 dist-test-slave-mjjr krb5kdc[3733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:36 dist-test-slave-mjjr krb5kdc[3733](info): set up 2 sockets
Aug 08 14:40:36 dist-test-slave-mjjr krb5kdc[3733](info): commencing operation
krb5kdc: starting...
W20260808 14:40:37.131577 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:37.246256 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37237
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:37.324851 3751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:37.325034 3751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:37.325057 3751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:37.326177 3751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:37.326218 3751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:37.326232 3751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:37.326269 3751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:37.326298 3751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:37.327788 3751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:37.328019 3751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:37.328229 3751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:37.332864 3758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.332898 3759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.332880 3764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:37.333058 3751 server_base.cc:1034] running on GCE node
I20260808 14:40:37.333352 3751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:37.333644 3751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:37.334813 3751 hybrid_clock.cc:648] HybridClock initialized: now 1786200037334820 us; error 54 us; skew 500 ppm
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:37.341290 3751 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:37.341609 3751 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:37.341679 3751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:37.341853 3751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:37.342866 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "55d755f16b464912bffce1a37962d1fc"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "463ef3bcd13d5098ab4160f6302f4b5f"
server_key_iv: "0e66e6b2efc2995abe38ae7d1230a2fe"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.343216 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "55d755f16b464912bffce1a37962d1fc"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "463ef3bcd13d5098ab4160f6302f4b5f"
server_key_iv: "0e66e6b2efc2995abe38ae7d1230a2fe"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.344563 3751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:37.345208 3773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.345376 3751 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:37.345474 3751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "55d755f16b464912bffce1a37962d1fc"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "463ef3bcd13d5098ab4160f6302f4b5f"
server_key_iv: "0e66e6b2efc2995abe38ae7d1230a2fe"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.345541 3751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:37.373000 3751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:37.374785 3751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:37.374962 3751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:37.378990 3751 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:37237
I20260808 14:40:37.379021 3841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:37237 every 8 connection(s)
I20260808 14:40:37.379297 3751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:37.380391 3842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:37.380635 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 3751
I20260808 14:40:37.380738 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:37.380950 30371 external_mini_cluster.cc:1428] Setting key 6c14d996fb177ab2816b4adc1a056175
I20260808 14:40:37.383852 3842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc: Bootstrap starting.
I20260808 14:40:37.384567 3842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:37.384846 3842 log.cc:824] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:37.385546 3842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc: No bootstrap required, opened a new log
I20260808 14:40:37.387272 3842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d755f16b464912bffce1a37962d1fc" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37237 } }
I20260808 14:40:37.387401 3842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:37.387424 3842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55d755f16b464912bffce1a37962d1fc, State: Initialized, Role: FOLLOWER
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:37.387584 3842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d755f16b464912bffce1a37962d1fc" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37237 } }
I20260808 14:40:37.387727 3842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:37.387779 3842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:37.387831 3842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:37.388352 3842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d755f16b464912bffce1a37962d1fc" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37237 } }
I20260808 14:40:37.388455 3842 leader_election.cc:302] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55d755f16b464912bffce1a37962d1fc; no voters:
I20260808 14:40:37.388618 3842 leader_election.cc:288] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:37.388671 3848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:37.388782 3848 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [term 1 LEADER]: Becoming Leader. State: Replica: 55d755f16b464912bffce1a37962d1fc, State: Running, Role: LEADER
I20260808 14:40:37.388897 3842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:37.389122 3848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d755f16b464912bffce1a37962d1fc" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37237 } }
I20260808 14:40:37.389519 3850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55d755f16b464912bffce1a37962d1fc. Latest consensus state: current_term: 1 leader_uuid: "55d755f16b464912bffce1a37962d1fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d755f16b464912bffce1a37962d1fc" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37237 } } }
I20260808 14:40:37.389601 3850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:37.389547 3849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55d755f16b464912bffce1a37962d1fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d755f16b464912bffce1a37962d1fc" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37237 } } }
I20260808 14:40:37.389639 3849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:37.390365 3860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:37.391057 3860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:37.391976 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.381492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53320 (local address 127.29.168.254:37237)
0808 14:40:37.381668 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.381677 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.381711 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:40:37.382142 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.382148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.382192 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.382312 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:37.383161 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.384153 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.385172 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.385576 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.385714 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.388126 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:37.388130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:37.388130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:37.388148 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:37.390052 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.390438 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.390441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.390441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.390550 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.390774 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.390775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.390775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.391052 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:37.391182 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.391694 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.391833 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260808 14:40:37.392943 3860 catalog_manager.cc:1347] Generated new cluster ID: 920275a84a2e422aa603e9859db21b68
I20260808 14:40:37.392994 3860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:37.396764 3860 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:37.397436 3860 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:37.402925 3860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc: Generated new TSK 0
I20260808 14:40:37.403082 3860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:37.430019 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37237
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:37.510854 3875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:37.511071 3875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:37.511107 3875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:37.512404 3875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:37.512471 3875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:37.512516 3875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:37.514074 3875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:37.514344 3875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:37.514568 3875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:37.519255 3885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.519255 3880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.519364 3881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:37.519687 3875 server_base.cc:1034] running on GCE node
I20260808 14:40:37.519858 3875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:37.520025 3875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:37.521178 3875 hybrid_clock.cc:648] HybridClock initialized: now 1786200037521169 us; error 27 us; skew 500 ppm
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:37.523523 3875 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:37.523921 3875 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:37.523972 3875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:37.524058 3875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:37.524976 3875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "25bd4ad040d64f118163cd60dc7ef532"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "815e0a7f246b2a0f1a1f7f7ef9848bd0"
server_key_iv: "929ac93d5db46428f7464650c63afdb5"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.525259 3875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "25bd4ad040d64f118163cd60dc7ef532"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "815e0a7f246b2a0f1a1f7f7ef9848bd0"
server_key_iv: "929ac93d5db46428f7464650c63afdb5"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.526568 3875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:37.527261 3896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.527428 3875 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:37.527520 3875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "25bd4ad040d64f118163cd60dc7ef532"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "815e0a7f246b2a0f1a1f7f7ef9848bd0"
server_key_iv: "929ac93d5db46428f7464650c63afdb5"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.527581 3875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:37.546052 3875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:37.547989 3875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:37.548200 3875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:37.548429 3875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:37.548705 3875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:37.548741 3875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.548763 3875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:37.548775 3875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.556901 3875 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38747
I20260808 14:40:37.556963 4051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38747 every 8 connection(s)
I20260808 14:40:37.557197 3875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:37.565639 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.557883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:42999 (local address 127.29.168.254:37237)
0808 14:40:37.557933 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.557936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.558133 (+ 197us) server_negotiation.cc:407] Connection header received
0808 14:40:37.558567 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.558568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.558577 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.558644 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:37.559524 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.560011 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.560890 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.561067 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.561114 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.562978 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:37.562979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:37.562980 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:37.562986 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:37.564402 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.564753 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.564753 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.564754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.564800 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.565067 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.565068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.565068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.565204 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:37.565281 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.565498 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.565573 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:40:37.565891 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 3875
I20260808 14:40:37.566020 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:37.566248 30371 external_mini_cluster.cc:1428] Setting key ab7420550e41002530355554d3aea1fa
I20260808 14:40:37.566483 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.557864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37237 (local address 127.29.168.193:42999)
0808 14:40:37.558019 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.558051 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.558474 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.558691 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.558694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.558928 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:37.559446 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.559452 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.560099 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.560100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.560816 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.560818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.561134 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.561134 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.561230 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.561611 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:37.561618 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:37.562885 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:37.564468 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:37.564474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:37.564476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:37.564687 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:37.564857 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:37.564857 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:37.564857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:37.564950 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:37.565278 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:37.565282 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:37.565384 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.565463 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.565573 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260808 14:40:37.567108 4053 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37237
I20260808 14:40:37.567215 4053 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:37.567368 4053 heartbeater.cc:511] Master 127.29.168.254:37237 requested a full tablet report, sending...
I20260808 14:40:37.568023 3791 ts_manager.cc:194] Registered new tserver with Master: 25bd4ad040d64f118163cd60dc7ef532 (127.29.168.193:38747)
I20260808 14:40:37.568910 3791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:42999
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:37.590749 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37237
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:37.670634 4059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:37.670868 4059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:37.670913 4059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:37.672070 4059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:37.672147 4059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:37.672192 4059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:37.673776 4059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:37.674052 4059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:37.674269 4059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:37.679139 4067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.679116 4070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.679154 4068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:37.679207 4059 server_base.cc:1034] running on GCE node
I20260808 14:40:37.679481 4059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:37.679759 4059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:37.680887 4059 hybrid_clock.cc:648] HybridClock initialized: now 1786200037680870 us; error 34 us; skew 500 ppm
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:37.683493 4059 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:37.683862 4059 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:37.683917 4059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:37.684005 4059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:37.684967 4059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "b89e76987c444ea3a9f5054c50170816"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "c209747e50fde6eceac3eed404099ce8"
server_key_iv: "67b0c7abffb607a611ba0040ead0bb16"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.685254 4059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "b89e76987c444ea3a9f5054c50170816"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "c209747e50fde6eceac3eed404099ce8"
server_key_iv: "67b0c7abffb607a611ba0040ead0bb16"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.686448 4059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:37.687203 4078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.687413 4059 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:37.687485 4059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "b89e76987c444ea3a9f5054c50170816"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "c209747e50fde6eceac3eed404099ce8"
server_key_iv: "67b0c7abffb607a611ba0040ead0bb16"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.687577 4059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:37.701690 4059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:37.703430 4059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:37.703578 4059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:37.703811 4059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:37.704125 4059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:37.704167 4059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.704188 4059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:37.704236 4059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.710119 4059 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:42195
I20260808 14:40:37.710186 4229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:42195 every 8 connection(s)
I20260808 14:40:37.710398 4059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:37.715171 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 4059
I20260808 14:40:37.715251 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:37.715427 30371 external_mini_cluster.cc:1428] Setting key e8235e547ad7ccc6c0e9c4fe2e23b6c2
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:37.719444 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.711063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:47847 (local address 127.29.168.254:37237)
0808 14:40:37.711128 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.711131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.711325 (+ 194us) server_negotiation.cc:407] Connection header received
0808 14:40:37.711807 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.711808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.711818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.711871 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:37.712803 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.713284 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.714193 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.714383 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.714430 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.716819 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:37.716821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:37.716821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:37.716828 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:37.718084 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.718475 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.718476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.718476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.718536 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.718826 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.718828 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.718828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.718938 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:37.719008 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.719266 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.719358 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:40:37.719609 4232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.711042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37237 (local address 127.29.168.194:47847)
0808 14:40:37.711210 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.711241 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.711714 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.711915 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.711918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.712228 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:37.712692 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.712697 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.713365 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.713366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.714124 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.714126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.714451 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.714452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.714572 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.715055 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:37.715063 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:37.716696 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:37.718167 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:37.718175 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:37.718177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:37.718395 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:37.718634 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:37.718635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:37.718635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:37.718754 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:37.719011 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:37.719018 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:37.719144 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.719243 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.719386 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260808 14:40:37.720093 4230 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37237
I20260808 14:40:37.720201 4230 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:37.720362 4230 heartbeater.cc:511] Master 127.29.168.254:37237 requested a full tablet report, sending...
I20260808 14:40:37.720719 3791 ts_manager.cc:194] Registered new tserver with Master: b89e76987c444ea3a9f5054c50170816 (127.29.168.194:42195)
I20260808 14:40:37.721068 3791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:47847
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:37.740520 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37237
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:37.822438 4236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:37.822631 4236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:37.822655 4236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:37.823853 4236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:37.823899 4236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:37.823927 4236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:37.825423 4236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:37.825677 4236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:37.825917 4236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:37.830972 4245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:37.831039 4247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:37.831074 4236 server_base.cc:1034] running on GCE node
W20260808 14:40:37.831001 4244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:37.831310 4236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:37.831643 4236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:37.832819 4236 hybrid_clock.cc:648] HybridClock initialized: now 1786200037832814 us; error 35 us; skew 500 ppm
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:37.835325 4236 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:37.835732 4236 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:37.835801 4236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:37.836019 4236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:37.837013 4236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "af01da98ded842dba8acf1e656abf458"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "e04a96c4eea58577becf2d9dfed1228a"
server_key_iv: "07852da9308b5a469950648e622173d4"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.837378 4236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "af01da98ded842dba8acf1e656abf458"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "e04a96c4eea58577becf2d9dfed1228a"
server_key_iv: "07852da9308b5a469950648e622173d4"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.838711 4236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:40:37.839435 4257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.839615 4236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:37.839733 4236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "af01da98ded842dba8acf1e656abf458"
format_stamp: "Formatted at 2026-08-08 14:40:37 on dist-test-slave-mjjr"
server_key: "e04a96c4eea58577becf2d9dfed1228a"
server_key_iv: "07852da9308b5a469950648e622173d4"
server_key_version: "encryptionkey@0"
I20260808 14:40:37.839799 4236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:37.849040 4236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:37.850656 4236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:37.850801 4236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:37.851008 4236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:37.851305 4236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:37.851352 4236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.851372 4236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:37.851413 4236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:37.857004 4236 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:35007
I20260808 14:40:37.857057 4430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:35007 every 8 connection(s)
I20260808 14:40:37.857335 4236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:40:37 dist-test-slave-mjjr krb5kdc[3733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200037, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:37.865165 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 4236
I20260808 14:40:37.865278 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:37.865483 30371 external_mini_cluster.cc:1428] Setting key ca60bceec48faf5d94e507b7d4fb08a0
I20260808 14:40:37.865890 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.857978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:51301 (local address 127.29.168.254:37237)
0808 14:40:37.858033 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.858035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.858230 (+ 195us) server_negotiation.cc:407] Connection header received
0808 14:40:37.858590 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.858590 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.858599 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.858645 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:37.859343 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.859808 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.860712 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.860899 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.860948 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.862809 (+ 1861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:37.862810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:37.862810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:37.862816 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:37.864050 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.864534 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.864536 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.864536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.864599 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.864961 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.864962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.864963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.865106 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:37.865182 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.865666 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.865760 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:40:37.865970 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.857958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37237 (local address 127.29.168.195:51301)
0808 14:40:37.858106 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.858142 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.858524 (+ 382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.858686 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.858689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.858893 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:37.859277 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.859281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.859877 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.859878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.860635 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.860637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.860968 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.860969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.861061 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.861429 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:37.861437 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:37.862689 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:37.864126 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:37.864132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:37.864133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:37.864440 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:37.864704 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:37.864704 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:37.864705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:37.864847 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:37.865196 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:37.865202 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:37.865426 (+ 224us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.865549 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.865707 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260808 14:40:37.866796 4431 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37237
I20260808 14:40:37.866888 4431 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:37.867043 4431 heartbeater.cc:511] Master 127.29.168.254:37237 requested a full tablet report, sending...
I20260808 14:40:37.867453 3791 ts_manager.cc:194] Registered new tserver with Master: af01da98ded842dba8acf1e656abf458 (127.29.168.195:35007)
I20260808 14:40:37.868057 3791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:51301
I20260808 14:40:37.869925 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:40:37.877781 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.871545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.29.168.254:37237)
0808 14:40:37.871579 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.871581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.871815 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:40:37.871932 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.871933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.871943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.872025 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:37.872768 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.873541 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.874509 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.874707 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.874779 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.875872 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:37.875873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:37.875874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:37.875879 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:37.876892 (+ 1013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.877180 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.877181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.877181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.877227 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:37.877362 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:37.877363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:37.877363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:37.877475 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:37.877545 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.877633 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.877685 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:40:37.879173 3791 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53332:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:37.880693 3791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:37.886546 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.882634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38747 (local address 127.0.0.1:35808)
0808 14:40:37.882819 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.882855 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.882926 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.883210 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.883213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.883215 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:37.883286 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.883288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.884662 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.884663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.885579 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.885582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.886246 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.886247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.886316 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.886335 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.886400 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.886443 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":40,"thread_start_us":70,"threads_started":1}
I20260808 14:40:37.886569 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.882742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35808 (local address 127.29.168.193:38747)
0808 14:40:37.882922 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.882926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.882937 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:37.883014 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.883016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.883033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.883109 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:37.883377 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.884543 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.885676 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.886171 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.886243 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.886294 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.886425 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.886465 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
I20260808 14:40:37.887210 4444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.882640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:35007 (local address 127.0.0.1:46600)
0808 14:40:37.882935 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.882945 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.882996 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.883292 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.883293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.883295 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:37.883342 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.883343 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.884638 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.884639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.886047 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.886049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.886956 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.886957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.887027 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.887031 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.887095 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.887137 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":44,"thread_start_us":70,"threads_started":1}
I20260808 14:40:37.887212 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.882698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46600 (local address 127.29.168.195:35007)
0808 14:40:37.883066 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.883070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.883079 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:37.883109 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.883111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.883125 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.883194 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:37.883419 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.884521 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.886128 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.886863 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.886939 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.886991 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.887106 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.887141 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":74,"threads_started":1}
I20260808 14:40:37.887349 3962 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff28fa416344b24b5b1d01bd079dc16 (DEFAULT_TABLE table=test-table [id=01abd5287e824b03815e371cf0c60626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:37.887744 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.882860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:42195 (local address 127.0.0.1:36248)
0808 14:40:37.883271 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.883280 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.883335 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.883617 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.883618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.883619 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:37.883683 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.883685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.884538 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.884539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.885787 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.885790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.887453 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.887454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.887538 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.887542 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.887594 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.887634 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":72,"thread_start_us":70,"threads_started":1}
I20260808 14:40:37.887840 3962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff28fa416344b24b5b1d01bd079dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:37.888062 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.883086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36248 (local address 127.29.168.194:42195)
0808 14:40:37.883247 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.883252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.883396 (+ 144us) server_negotiation.cc:407] Connection header received
0808 14:40:37.883443 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.883445 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.883460 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.883531 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:37.883748 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.884413 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.885884 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.886964 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.887189 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.887884 (+ 695us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.887908 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.887992 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
I20260808 14:40:37.888298 4323 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff28fa416344b24b5b1d01bd079dc16 (DEFAULT_TABLE table=test-table [id=01abd5287e824b03815e371cf0c60626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:37.888636 4323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff28fa416344b24b5b1d01bd079dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:37.888618 4140 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff28fa416344b24b5b1d01bd079dc16 (DEFAULT_TABLE table=test-table [id=01abd5287e824b03815e371cf0c60626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:37.888911 4140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff28fa416344b24b5b1d01bd079dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:37.891511 4451 tablet_bootstrap.cc:492] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532: Bootstrap starting.
I20260808 14:40:37.891789 4454 tablet_bootstrap.cc:492] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: Bootstrap starting.
I20260808 14:40:37.892319 4455 tablet_bootstrap.cc:492] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Bootstrap starting.
I20260808 14:40:37.892367 4451 tablet_bootstrap.cc:654] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:37.892501 4454 tablet_bootstrap.cc:654] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:37.892966 4455 tablet_bootstrap.cc:654] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:37.893064 4451 log.cc:824] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:37.893217 4454 log.cc:824] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:37.893646 4455 log.cc:824] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:37.893957 4451 tablet_bootstrap.cc:492] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532: No bootstrap required, opened a new log
I20260808 14:40:37.894038 4451 ts_tablet_manager.cc:1397] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:40:37.894066 4454 tablet_bootstrap.cc:492] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: No bootstrap required, opened a new log
I20260808 14:40:37.894136 4454 ts_tablet_manager.cc:1397] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:40:37.894410 4455 tablet_bootstrap.cc:492] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: No bootstrap required, opened a new log
I20260808 14:40:37.894474 4455 ts_tablet_manager.cc:1397] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:40:37.895581 4454 raft_consensus.cc:348] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.895773 4454 raft_consensus.cc:374] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:37.895818 4454 raft_consensus.cc:729] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89e76987c444ea3a9f5054c50170816, State: Initialized, Role: FOLLOWER
I20260808 14:40:37.895953 4454 consensus_queue.cc:260] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.895944 4451 raft_consensus.cc:348] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.896090 4451 raft_consensus.cc:374] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:37.896121 4451 raft_consensus.cc:729] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25bd4ad040d64f118163cd60dc7ef532, State: Initialized, Role: FOLLOWER
I20260808 14:40:37.896215 4454 ts_tablet_manager.cc:1428] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:40:37.896227 4451 consensus_queue.cc:260] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.896356 4230 heartbeater.cc:503] Master 127.29.168.254:37237 was elected leader, sending a full tablet report...
I20260808 14:40:37.896497 4451 ts_tablet_manager.cc:1428] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:40:37.896515 4053 heartbeater.cc:503] Master 127.29.168.254:37237 was elected leader, sending a full tablet report...
I20260808 14:40:37.896301 4455 raft_consensus.cc:348] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.896778 4455 raft_consensus.cc:374] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:37.896818 4455 raft_consensus.cc:729] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af01da98ded842dba8acf1e656abf458, State: Initialized, Role: FOLLOWER
I20260808 14:40:37.896934 4455 consensus_queue.cc:260] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.897222 4455 ts_tablet_manager.cc:1428] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:40:37.897424 4431 heartbeater.cc:503] Master 127.29.168.254:37237 was elected leader, sending a full tablet report...
W20260808 14:40:37.960883 4231 tablet.cc:2369] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:37.961105 4460 raft_consensus.cc:482] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:37.961236 4460 raft_consensus.cc:504] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.961619 4460 leader_election.cc:288] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af01da98ded842dba8acf1e656abf458 (127.29.168.195:35007), b89e76987c444ea3a9f5054c50170816 (127.29.168.194:42195)
I20260808 14:40:37.964543 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.961887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:49463 (local address 127.29.168.194:42195)
0808 14:40:37.961940 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.961942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.961949 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:37.961973 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.961974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.961982 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.962024 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:37.962212 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.962712 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.963744 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.964169 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.964227 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.964234 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.964419 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.964465 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:37.964556 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.961808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:42195 (local address 127.29.168.193:49463)
0808 14:40:37.961860 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.961873 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.961914 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.962036 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.962037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.962038 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:37.962111 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.962113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.962816 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.962817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.963606 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.963608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.964255 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.964256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.964342 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.964345 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.964403 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.964433 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:40:37.964623 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.961865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:56039 (local address 127.29.168.195:35007)
0808 14:40:37.961909 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.961911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.962114 (+ 203us) server_negotiation.cc:407] Connection header received
0808 14:40:37.962152 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.962153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.962162 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.962208 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:37.962374 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.962848 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.963828 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.964220 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.964310 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.964320 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.964485 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.964538 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:40:37.964690 4462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.961814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:35007 (local address 127.29.168.193:56039)
0808 14:40:37.962042 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.962051 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:37.962104 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:37.962228 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:37.962229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:37.962230 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:37.962296 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.962298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.962932 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.962933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.963738 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:37.963740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.964315 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.964316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:37.964397 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.964402 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:40:37.964461 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:40:37.964506 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":65,"thread_start_us":107,"threads_started":1}
I20260808 14:40:37.964968 4172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff28fa416344b24b5b1d01bd079dc16" candidate_uuid: "25bd4ad040d64f118163cd60dc7ef532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89e76987c444ea3a9f5054c50170816" is_pre_election: true
I20260808 14:40:37.965097 4354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff28fa416344b24b5b1d01bd079dc16" candidate_uuid: "25bd4ad040d64f118163cd60dc7ef532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af01da98ded842dba8acf1e656abf458" is_pre_election: true
I20260808 14:40:37.965135 4172 raft_consensus.cc:2454] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25bd4ad040d64f118163cd60dc7ef532 in term 0.
I20260808 14:40:37.965241 4354 raft_consensus.cc:2454] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25bd4ad040d64f118163cd60dc7ef532 in term 0.
I20260808 14:40:37.965382 3899 leader_election.cc:302] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25bd4ad040d64f118163cd60dc7ef532, b89e76987c444ea3a9f5054c50170816; no voters:
I20260808 14:40:37.965513 4460 raft_consensus.cc:2781] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:37.965582 4460 raft_consensus.cc:482] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:37.965626 4460 raft_consensus.cc:3037] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:37.966253 4460 raft_consensus.cc:504] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.966406 4460 leader_election.cc:288] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [CANDIDATE]: Term 1 election: Requested vote from peers af01da98ded842dba8acf1e656abf458 (127.29.168.195:35007), b89e76987c444ea3a9f5054c50170816 (127.29.168.194:42195)
I20260808 14:40:37.966583 4172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff28fa416344b24b5b1d01bd079dc16" candidate_uuid: "25bd4ad040d64f118163cd60dc7ef532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89e76987c444ea3a9f5054c50170816"
I20260808 14:40:37.966610 4354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff28fa416344b24b5b1d01bd079dc16" candidate_uuid: "25bd4ad040d64f118163cd60dc7ef532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af01da98ded842dba8acf1e656abf458"
I20260808 14:40:37.966679 4354 raft_consensus.cc:3037] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:37.966684 4172 raft_consensus.cc:3037] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:37.967357 4354 raft_consensus.cc:2454] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25bd4ad040d64f118163cd60dc7ef532 in term 1.
I20260808 14:40:37.967463 4172 raft_consensus.cc:2454] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25bd4ad040d64f118163cd60dc7ef532 in term 1.
I20260808 14:40:37.967531 3900 leader_election.cc:302] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25bd4ad040d64f118163cd60dc7ef532, af01da98ded842dba8acf1e656abf458; no voters:
I20260808 14:40:37.967623 4460 raft_consensus.cc:2781] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:37.967815 4460 raft_consensus.cc:686] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [term 1 LEADER]: Becoming Leader. State: Replica: 25bd4ad040d64f118163cd60dc7ef532, State: Running, Role: LEADER
I20260808 14:40:37.967922 4460 consensus_queue.cc:237] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } }
I20260808 14:40:37.968631 3791 catalog_manager.cc:5495] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25bd4ad040d64f118163cd60dc7ef532 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "25bd4ad040d64f118163cd60dc7ef532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bd4ad040d64f118163cd60dc7ef532" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:37.978047 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.976135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35820 (local address 127.29.168.193:38747)
0808 14:40:37.976189 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:37.976191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:37.976197 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:37.976220 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:37.976221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:37.976233 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:37.976283 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:37.976395 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.976781 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.977453 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:37.977627 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:37.977694 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:37.977808 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:37.977887 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:37.977938 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:37.977974 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:40:37.977987 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:40:37.979710 4172 raft_consensus.cc:1261] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 1 FOLLOWER]: Refusing update from remote peer 25bd4ad040d64f118163cd60dc7ef532: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:37.979733 4354 raft_consensus.cc:1261] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 1 FOLLOWER]: Refusing update from remote peer 25bd4ad040d64f118163cd60dc7ef532: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:37.980021 4460 consensus_queue.cc:1035] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89e76987c444ea3a9f5054c50170816" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 42195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:37.980145 4465 consensus_queue.cc:1035] T 1ff28fa416344b24b5b1d01bd079dc16 P 25bd4ad040d64f118163cd60dc7ef532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af01da98ded842dba8acf1e656abf458" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 35007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:37.983364 4472 mvcc.cc:205] Tried to move back new op lower bound from 7316275355562090496 to 7316275355517079552. Current Snapshot: MvccSnapshot[applied={T|T < 7316275355562090496 or (T in {7316275355562090496})}]
I20260808 14:40:37.984546 3792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:37.984634 3792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:37.985358 3792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55d755f16b464912bffce1a37962d1fc: Sending DeleteTablet for 3 replicas of tablet 1ff28fa416344b24b5b1d01bd079dc16
I20260808 14:40:37.985704 3962 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff28fa416344b24b5b1d01bd079dc16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:37 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:35808
I20260808 14:40:37.985749 4140 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff28fa416344b24b5b1d01bd079dc16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:37 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:36248
I20260808 14:40:37.985749 4323 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff28fa416344b24b5b1d01bd079dc16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:37 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:46600
I20260808 14:40:37.985999 4484 tablet_replica.cc:330] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: stopping tablet replica
I20260808 14:40:37.986093 4484 raft_consensus.cc:2229] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:37.986176 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 3875
I20260808 14:40:37.986187 4484 raft_consensus.cc:2258] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:37.989622 4485 tablet_replica.cc:330] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816: stopping tablet replica
I20260808 14:40:37.989728 4485 raft_consensus.cc:2229] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:37.989823 4485 raft_consensus.cc:2258] T 1ff28fa416344b24b5b1d01bd079dc16 P b89e76987c444ea3a9f5054c50170816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:37.989919 4484 ts_tablet_manager.cc:1905] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:37.991369 4484 ts_tablet_manager.cc:1918] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:37.991426 4484 log.cc:1196] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/1ff28fa416344b24b5b1d01bd079dc16
I20260808 14:40:37.991753 4484 ts_tablet_manager.cc:1939] T 1ff28fa416344b24b5b1d01bd079dc16 P af01da98ded842dba8acf1e656abf458: Deleting consensus metadata
I20260808 14:40:37.992123 3776 catalog_manager.cc:4841] TS af01da98ded842dba8acf1e656abf458 (127.29.168.195:35007): tablet 1ff28fa416344b24b5b1d01bd079dc16 (table test-table [id=01abd5287e824b03815e371cf0c60626]) successfully deleted
W20260808 14:40:37.994704 3775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:38747 (error 108)
I20260808 14:40:37.995118 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 4059
I20260808 14:40:37.995153 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:37.995022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38747 (local address 127.0.0.1:35832)
0808 14:40:37.995078 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:37.995120 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:40:38.000110 3775 catalog_manager.cc:4584] TS 25bd4ad040d64f118163cd60dc7ef532 (127.29.168.193:38747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ff28fa416344b24b5b1d01bd079dc16: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38747: connect: Connection refused (error 111)
I20260808 14:40:38.012637 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.012497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:42195 (local address 127.0.0.1:36264)
0808 14:40:38.012570 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.012602 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.194:42195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:40:38.012643 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 4236
I20260808 14:40:38.023320 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 3751
2026-08-08T14:40:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2057 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T14:40:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:38Z Disabled control of system clock
I20260808 14:40:38.053126 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:34093
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:43985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:34093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:40:38.131582 4493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:38.131775 4493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:38.131796 4493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:38.132812 4493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:38.132845 4493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:38.132858 4493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:38.132870 4493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:38.132882 4493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:38.134146 4493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:43985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:34093
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:34093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:38.134328 4493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:38.134543 4493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:38.139287 4500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.139384 4493 server_base.cc:1034] running on GCE node
W20260808 14:40:38.139302 4503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.139297 4501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.139760 4493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:38.140061 4493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:38.141223 4493 hybrid_clock.cc:648] HybridClock initialized: now 1786200038141208 us; error 27 us; skew 500 ppm
I20260808 14:40:38.142325 4493 webserver.cc:460] Webserver started at http://127.29.168.254:35501/ using document root <none> and password file <none>
I20260808 14:40:38.142570 4493 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:38.142637 4493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:38.142820 4493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:38.143895 4493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "97aca32adb04e344abe8387e3d61341e"
server_key_iv: "f363831ec7ca8130e9bc187f0a5ff789"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.144238 4493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "97aca32adb04e344abe8387e3d61341e"
server_key_iv: "f363831ec7ca8130e9bc187f0a5ff789"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.145506 4493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:38.146222 4509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.146392 4493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:38.146500 4493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "97aca32adb04e344abe8387e3d61341e"
server_key_iv: "f363831ec7ca8130e9bc187f0a5ff789"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.146587 4493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:38.149794 4493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:38.150027 4493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:38.150166 4493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:38.154215 4493 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:34093
I20260808 14:40:38.154245 4587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:34093 every 8 connection(s)
I20260808 14:40:38.154633 4493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:38.155296 4588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:38.157039 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 4493
I20260808 14:40:38.157148 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:38.157341 30371 external_mini_cluster.cc:1428] Setting key bd868900f12ec96e81c21254174b1e34
I20260808 14:40:38.158388 4588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402: Bootstrap starting.
I20260808 14:40:38.159111 4588 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:38.159467 4588 log.cc:824] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:38.159790 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.157869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.29.168.254:34093)
0808 14:40:38.158035 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.158041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.158063 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:40:38.158415 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.158421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.158491 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.158611 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.159272 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.159276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.159276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.159287 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.159336 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.159346 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.159412 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.159490 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.159564 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
I20260808 14:40:38.160264 4588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402: No bootstrap required, opened a new log
I20260808 14:40:38.161481 4588 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 34093 } }
I20260808 14:40:38.161590 4588 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:38.161609 4588 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ac59f79ac54ce6b7c6dc77e8d1a402, State: Initialized, Role: FOLLOWER
I20260808 14:40:38.161686 4588 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 34093 } }
I20260808 14:40:38.161736 4588 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:38.161772 4588 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:38.161796 4588 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:38.162448 4588 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 34093 } }
I20260808 14:40:38.162528 4588 leader_election.cc:302] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2ac59f79ac54ce6b7c6dc77e8d1a402; no voters:
I20260808 14:40:38.162635 4588 leader_election.cc:288] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:38.162701 4594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:38.162907 4594 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [term 1 LEADER]: Becoming Leader. State: Replica: b2ac59f79ac54ce6b7c6dc77e8d1a402, State: Running, Role: LEADER
I20260808 14:40:38.162925 4588 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:38.162998 4594 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 34093 } }
I20260808 14:40:38.163353 4595 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 34093 } } }
I20260808 14:40:38.163458 4595 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:38.163357 4596 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2ac59f79ac54ce6b7c6dc77e8d1a402. Latest consensus state: current_term: 1 leader_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ac59f79ac54ce6b7c6dc77e8d1a402" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 34093 } } }
I20260808 14:40:38.163602 4596 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:38.163746 4604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:38.164189 4604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:38.165616 4604 catalog_manager.cc:1347] Generated new cluster ID: 502dec26158140c288394ce0018c5246
I20260808 14:40:38.165666 4604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:38.181389 4604 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:38.181563 4604 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:38.193399 4604 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402: Generated new TSK 0
I20260808 14:40:38.193590 4604 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:38.194880 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:34093
--builtin_ntp_servers=127.29.168.212:43985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:40:38.275938 4625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:38.276106 4625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:38.276126 4625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:38.277179 4625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:38.277215 4625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:38.277237 4625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:38.278566 4625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:43985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:34093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:38.278779 4625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:38.279072 4625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:38.284554 4632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.284601 4635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.284894 4625 server_base.cc:1034] running on GCE node
W20260808 14:40:38.284653 4631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.285144 4625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:38.285374 4625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:38.286531 4625 hybrid_clock.cc:648] HybridClock initialized: now 1786200038286519 us; error 27 us; skew 500 ppm
I20260808 14:40:38.287842 4625 webserver.cc:460] Webserver started at http://127.29.168.193:46663/ using document root <none> and password file <none>
I20260808 14:40:38.288080 4625 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:38.288146 4625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:38.288295 4625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:38.289273 4625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "700fa60a5a374b0698e7b1ec7d86ade6"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "1b950fced1fc3f611cdc2e83f020af93"
server_key_iv: "fcf43bfd7b1109a27387a7fd5e55acee"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.289628 4625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "700fa60a5a374b0698e7b1ec7d86ade6"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "1b950fced1fc3f611cdc2e83f020af93"
server_key_iv: "fcf43bfd7b1109a27387a7fd5e55acee"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.290867 4625 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:38.291513 4643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.291725 4625 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:38.291814 4625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "700fa60a5a374b0698e7b1ec7d86ade6"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "1b950fced1fc3f611cdc2e83f020af93"
server_key_iv: "fcf43bfd7b1109a27387a7fd5e55acee"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.291898 4625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:38.295060 4625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:38.295369 4625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:38.295490 4625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:38.295737 4625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:38.296015 4625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:38.296064 4625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.296097 4625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:38.296120 4625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.301570 4625 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:35209
I20260808 14:40:38.301673 4806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:35209 every 8 connection(s)
I20260808 14:40:38.301944 4625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:38.302313 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 4625
I20260808 14:40:38.302424 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:38.302625 30371 external_mini_cluster.cc:1428] Setting key 31bf25e4fbd6154b36f604a9da0a85b9
I20260808 14:40:38.303606 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:34093
--builtin_ntp_servers=127.29.168.212:43985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:40:38.305042 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.302708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:43699 (local address 127.29.168.254:34093)
0808 14:40:38.302783 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.302785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.303019 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:40:38.303545 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.303546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.303553 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.303623 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.304785 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.304787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.304787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.304792 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.304807 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.304812 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.304878 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.304929 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.304943 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:38.305140 4810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.302671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:34093 (local address 127.29.168.193:43699)
0808 14:40:38.302911 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.302950 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.303442 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.303717 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.303722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.303735 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.304643 (+ 908us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.304644 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.304668 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.304692 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.304876 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.304878 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.304880 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.304926 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.304969 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":115,"threads_started":1}
I20260808 14:40:38.305632 4808 heartbeater.cc:347] Connected to a master server at 127.29.168.254:34093
I20260808 14:40:38.305733 4808 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:38.305896 4808 heartbeater.cc:511] Master 127.29.168.254:34093 requested a full tablet report, sending...
I20260808 14:40:38.306398 4533 ts_manager.cc:194] Registered new tserver with Master: 700fa60a5a374b0698e7b1ec7d86ade6 (127.29.168.193:35209)
W20260808 14:40:38.381484 4811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:38.381666 4811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:38.381685 4811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:38.382721 4811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:38.382762 4811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:38.382804 4811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:38.384177 4811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:43985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:34093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:38.384399 4811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:38.384688 4811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:38.389585 4820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.389592 4821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.389762 4811 server_base.cc:1034] running on GCE node
W20260808 14:40:38.389606 4825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.390033 4811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:38.390285 4811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:38.391450 4811 hybrid_clock.cc:648] HybridClock initialized: now 1786200038391441 us; error 32 us; skew 500 ppm
I20260808 14:40:38.392935 4811 webserver.cc:460] Webserver started at http://127.29.168.194:41419/ using document root <none> and password file <none>
I20260808 14:40:38.393229 4811 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:38.393314 4811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:38.393455 4811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:38.394593 4811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "b464d965082c4fedb76badb655806867"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "13fb7365561d1ec6fd2445c4f1011bb5"
server_key_iv: "258873a1c3a43562494d8580b9562827"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.394945 4811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "b464d965082c4fedb76badb655806867"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "13fb7365561d1ec6fd2445c4f1011bb5"
server_key_iv: "258873a1c3a43562494d8580b9562827"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.396391 4811 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:38.397053 4832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.397293 4811 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:38.397392 4811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "b464d965082c4fedb76badb655806867"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "13fb7365561d1ec6fd2445c4f1011bb5"
server_key_iv: "258873a1c3a43562494d8580b9562827"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.397486 4811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:38.400672 4811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:38.400920 4811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:38.401067 4811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:38.401258 4811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:38.401558 4811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:38.401612 4811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.401648 4811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:38.401674 4811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.407411 4811 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:43699
I20260808 14:40:38.407445 4985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:43699 every 8 connection(s)
I20260808 14:40:38.407810 4811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:38.409217 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 4811
I20260808 14:40:38.409330 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:38.409524 30371 external_mini_cluster.cc:1428] Setting key 39d1594f7c3734ecd70e6feedb2b319f
I20260808 14:40:38.410547 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:34093
--builtin_ntp_servers=127.29.168.212:43985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:40:38.411118 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.408565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:54747 (local address 127.29.168.254:34093)
0808 14:40:38.408619 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.408621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.408845 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:40:38.409318 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.409319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.409326 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.409389 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.410862 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.410864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.410864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.410867 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.410898 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.410902 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.410950 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.411056 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.411067 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:40:38.411345 4989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.408556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:34093 (local address 127.29.168.194:54747)
0808 14:40:38.408716 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.408763 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.409207 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.409451 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.409455 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.409465 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.410688 (+ 1223us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.410688 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.410722 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.410780 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.410971 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.410977 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.410979 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.411060 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.411120 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260808 14:40:38.411891 4986 heartbeater.cc:347] Connected to a master server at 127.29.168.254:34093
I20260808 14:40:38.411975 4986 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:38.412147 4986 heartbeater.cc:511] Master 127.29.168.254:34093 requested a full tablet report, sending...
I20260808 14:40:38.412472 4533 ts_manager.cc:194] Registered new tserver with Master: b464d965082c4fedb76badb655806867 (127.29.168.194:43699)
W20260808 14:40:38.489285 4990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:38.489452 4990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:38.489473 4990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:38.490541 4990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:38.490599 4990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:38.490624 4990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:38.492041 4990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:43985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:34093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:38.492254 4990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:38.492522 4990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:38.497494 5005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.497494 4999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.497689 5000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.497809 4990 server_base.cc:1034] running on GCE node
I20260808 14:40:38.498031 4990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:38.498270 4990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:38.499421 4990 hybrid_clock.cc:648] HybridClock initialized: now 1786200038499410 us; error 24 us; skew 500 ppm
I20260808 14:40:38.500638 4990 webserver.cc:460] Webserver started at http://127.29.168.195:35723/ using document root <none> and password file <none>
I20260808 14:40:38.500946 4990 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:38.501004 4990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:38.501130 4990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:38.502102 4990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "12388afd747a4c638523625653a8267d"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "5456bad3b38f50a54b311c1a3ed90594"
server_key_iv: "70d85b7c67b430166ae871da354fdd60"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.502452 4990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "12388afd747a4c638523625653a8267d"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "5456bad3b38f50a54b311c1a3ed90594"
server_key_iv: "70d85b7c67b430166ae871da354fdd60"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.503795 4990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:38.504593 5015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.504796 4990 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:38.504890 4990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "12388afd747a4c638523625653a8267d"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "5456bad3b38f50a54b311c1a3ed90594"
server_key_iv: "70d85b7c67b430166ae871da354fdd60"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.504976 4990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:38.508253 4990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:38.508490 4990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:38.508617 4990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:38.508836 4990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:38.509123 4990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:38.509174 4990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.509212 4990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:38.509238 4990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.514858 4990 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:40749
I20260808 14:40:38.514901 5177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:40749 every 8 connection(s)
I20260808 14:40:38.515190 4990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:38.515966 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 4990
I20260808 14:40:38.516085 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:38.516268 30371 external_mini_cluster.cc:1428] Setting key 7e7c90f999a57a8f611b363014f32fbe
I20260808 14:40:38.518038 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.515868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:55519 (local address 127.29.168.254:34093)
0808 14:40:38.515910 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.515912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.516216 (+ 304us) server_negotiation.cc:407] Connection header received
0808 14:40:38.516671 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.516672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.516678 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.516727 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.517869 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.517870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.517871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.517874 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.517888 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.517891 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.517934 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.517977 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.517988 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:38.518203 5182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.515875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:34093 (local address 127.29.168.195:55519)
0808 14:40:38.516097 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.516138 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.516576 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.516773 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.516776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.516783 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.517729 (+ 946us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.517730 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.517761 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.517786 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.517933 (+ 147us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.517936 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.517937 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.517984 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.518027 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260808 14:40:38.518630 5178 heartbeater.cc:347] Connected to a master server at 127.29.168.254:34093
I20260808 14:40:38.518726 5178 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:38.518873 5178 heartbeater.cc:511] Master 127.29.168.254:34093 requested a full tablet report, sending...
I20260808 14:40:38.519191 4533 ts_manager.cc:194] Registered new tserver with Master: 12388afd747a4c638523625653a8267d (127.29.168.195:40749)
I20260808 14:40:38.528213 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:40:38.530483 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.529522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48784 (local address 127.29.168.254:34093)
0808 14:40:38.529583 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.529585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.529736 (+ 151us) server_negotiation.cc:407] Connection header received
0808 14:40:38.529787 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.529787 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.529791 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.529849 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.530330 (+ 481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.530331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.530331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.530335 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.530346 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.530349 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.530392 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.530428 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.530438 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:40:38.531971 4533 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:38.533597 4533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:38.537464 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.535731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:35209 (local address 127.0.0.1:59932)
0808 14:40:38.535871 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.535906 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.535960 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.536584 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.536590 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.536597 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.537048 (+ 451us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.537048 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.537063 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.537082 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.537310 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.537315 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.537318 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.537381 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.537394 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":53,"threads_started":1}
I20260808 14:40:38.537618 5192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.535963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:40749 (local address 127.0.0.1:41232)
0808 14:40:38.536079 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.536086 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.536109 (+ 23us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.536672 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.536673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.536676 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.537190 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.537190 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.537199 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.537207 (+ 8us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.537399 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.537400 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.537401 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.537457 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.537470 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260808 14:40:38.537524 5191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.535822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59932 (local address 127.29.168.193:35209)
0808 14:40:38.536421 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.536426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.536437 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:38.536465 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.536467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.536477 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.536818 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.537148 (+ 330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.537152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.537153 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.537157 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.537189 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.537207 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.537318 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.537391 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.537409 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":94,"threads_started":1}
I20260808 14:40:38.537849 5197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.536367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41232 (local address 127.29.168.195:40749)
0808 14:40:38.536530 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.536533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.536542 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:38.536563 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.536564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.536571 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.536837 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.537275 (+ 438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.537281 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.537281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.537285 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.537314 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.537342 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.537399 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.537746 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.537767 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260808 14:40:38.537976 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.535774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43699 (local address 127.0.0.1:48014)
0808 14:40:38.536014 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.536024 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.536070 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.536727 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.536728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.536730 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.537445 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.537446 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.537450 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.537459 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.537829 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.537831 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.537831 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.537905 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.537918 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":85,"threads_started":1}
I20260808 14:40:38.538008 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.536118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48014 (local address 127.29.168.194:43699)
0808 14:40:38.536277 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.536281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.536288 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:38.536338 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.536340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.536350 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.536423 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.537681 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.537687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.537687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.537712 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.537747 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.537771 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.537828 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.537912 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.537926 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":100,"threads_started":1}
I20260808 14:40:38.538524 5079 tablet_service.cc:1467] Processing CreateTablet for tablet bc095c93ce0d442f94585096de8ecab7 (DEFAULT_TABLE table=test-table [id=f555ba233fcc4f6aa3ac1159f8d7d003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:38.538630 4904 tablet_service.cc:1467] Processing CreateTablet for tablet bc095c93ce0d442f94585096de8ecab7 (DEFAULT_TABLE table=test-table [id=f555ba233fcc4f6aa3ac1159f8d7d003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:38.538877 5079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc095c93ce0d442f94585096de8ecab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:38.538982 4904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc095c93ce0d442f94585096de8ecab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:38.538946 4708 tablet_service.cc:1467] Processing CreateTablet for tablet bc095c93ce0d442f94585096de8ecab7 (DEFAULT_TABLE table=test-table [id=f555ba233fcc4f6aa3ac1159f8d7d003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:38.539256 4708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc095c93ce0d442f94585096de8ecab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:38.541642 5201 tablet_bootstrap.cc:492] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Bootstrap starting.
I20260808 14:40:38.542426 5201 tablet_bootstrap.cc:654] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:38.542428 5203 tablet_bootstrap.cc:492] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Bootstrap starting.
I20260808 14:40:38.542516 5204 tablet_bootstrap.cc:492] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: Bootstrap starting.
I20260808 14:40:38.542833 5201 log.cc:824] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:38.543054 5203 tablet_bootstrap.cc:654] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:38.543236 5204 tablet_bootstrap.cc:654] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:38.543390 5203 log.cc:824] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:38.543583 5204 log.cc:824] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:38.543730 5201 tablet_bootstrap.cc:492] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: No bootstrap required, opened a new log
I20260808 14:40:38.543813 5201 ts_tablet_manager.cc:1397] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:38.544225 5203 tablet_bootstrap.cc:492] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: No bootstrap required, opened a new log
I20260808 14:40:38.544303 5203 ts_tablet_manager.cc:1397] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:38.544461 5204 tablet_bootstrap.cc:492] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: No bootstrap required, opened a new log
I20260808 14:40:38.544524 5204 ts_tablet_manager.cc:1397] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:40:38.546175 5201 raft_consensus.cc:348] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.546339 5201 raft_consensus.cc:374] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:38.546383 5201 raft_consensus.cc:729] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12388afd747a4c638523625653a8267d, State: Initialized, Role: FOLLOWER
I20260808 14:40:38.546566 5201 consensus_queue.cc:260] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.546859 5201 ts_tablet_manager.cc:1428] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:40:38.547006 5178 heartbeater.cc:503] Master 127.29.168.254:34093 was elected leader, sending a full tablet report...
I20260808 14:40:38.547036 5204 raft_consensus.cc:348] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.547183 5204 raft_consensus.cc:374] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:38.547225 5204 raft_consensus.cc:729] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 700fa60a5a374b0698e7b1ec7d86ade6, State: Initialized, Role: FOLLOWER
I20260808 14:40:38.547341 5204 consensus_queue.cc:260] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.546929 5203 raft_consensus.cc:348] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.547525 5203 raft_consensus.cc:374] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:38.547580 5203 raft_consensus.cc:729] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b464d965082c4fedb76badb655806867, State: Initialized, Role: FOLLOWER
I20260808 14:40:38.547609 5204 ts_tablet_manager.cc:1428] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:40:38.547756 4808 heartbeater.cc:503] Master 127.29.168.254:34093 was elected leader, sending a full tablet report...
I20260808 14:40:38.547747 5203 consensus_queue.cc:260] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.548127 5203 ts_tablet_manager.cc:1428] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 14:40:38.548236 4986 heartbeater.cc:503] Master 127.29.168.254:34093 was elected leader, sending a full tablet report...
W20260808 14:40:38.552455 4809 tablet.cc:2369] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:40:38.658382 4988 tablet.cc:2369] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:38.676110 5210 raft_consensus.cc:482] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:38.676276 5210 raft_consensus.cc:504] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.676656 5210 leader_election.cc:288] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b464d965082c4fedb76badb655806867 (127.29.168.194:43699), 700fa60a5a374b0698e7b1ec7d86ade6 (127.29.168.193:35209)
I20260808 14:40:38.678072 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.676966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:53553 (local address 127.29.168.194:43699)
0808 14:40:38.677056 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.677058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.677067 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:38.677107 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.677109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.677115 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.677173 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.677828 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.677829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.677829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.677832 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.677848 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.677852 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.677933 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.677992 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.678006 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:40:38.678072 5182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.676882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43699 (local address 127.29.168.195:53553)
0808 14:40:38.676929 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.676941 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.677018 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.677211 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.677213 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.677216 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.677716 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.677717 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.677726 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.677740 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.677932 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.677933 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.677934 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.677990 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.678006 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:40:38.678128 5191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.676970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:48665 (local address 127.29.168.193:35209)
0808 14:40:38.677037 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.677039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.677344 (+ 305us) server_negotiation.cc:407] Connection header received
0808 14:40:38.677417 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.677418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.677424 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.677485 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.677890 (+ 405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.677892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.677892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.677896 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.677912 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.677917 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.677990 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.678043 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.678058 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:40:38.678363 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.676882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:35209 (local address 127.29.168.195:48665)
0808 14:40:38.677255 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.677265 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.677334 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.677494 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.677494 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.677496 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:38.677785 (+ 289us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:40:38.677786 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:38.677791 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:40:38.677801 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:38.677985 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:38.677986 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:38.677987 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:40:38.678044 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:40:38.678058 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":189,"thread_start_us":110,"threads_started":1}
I20260808 14:40:38.678443 4931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc095c93ce0d442f94585096de8ecab7" candidate_uuid: "12388afd747a4c638523625653a8267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b464d965082c4fedb76badb655806867" is_pre_election: true
I20260808 14:40:38.678588 4931 raft_consensus.cc:2454] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12388afd747a4c638523625653a8267d in term 0.
I20260808 14:40:38.678714 4736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc095c93ce0d442f94585096de8ecab7" candidate_uuid: "12388afd747a4c638523625653a8267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" is_pre_election: true
I20260808 14:40:38.678840 5018 leader_election.cc:302] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12388afd747a4c638523625653a8267d, b464d965082c4fedb76badb655806867; no voters:
I20260808 14:40:38.678890 4736 raft_consensus.cc:2454] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12388afd747a4c638523625653a8267d in term 0.
I20260808 14:40:38.678961 5210 raft_consensus.cc:2781] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:38.679035 5210 raft_consensus.cc:482] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:38.679059 5210 raft_consensus.cc:3037] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:38.679844 5210 raft_consensus.cc:504] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.679984 5210 leader_election.cc:288] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [CANDIDATE]: Term 1 election: Requested vote from peers b464d965082c4fedb76badb655806867 (127.29.168.194:43699), 700fa60a5a374b0698e7b1ec7d86ade6 (127.29.168.193:35209)
I20260808 14:40:38.680172 4931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc095c93ce0d442f94585096de8ecab7" candidate_uuid: "12388afd747a4c638523625653a8267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b464d965082c4fedb76badb655806867"
I20260808 14:40:38.680212 4736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc095c93ce0d442f94585096de8ecab7" candidate_uuid: "12388afd747a4c638523625653a8267d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "700fa60a5a374b0698e7b1ec7d86ade6"
I20260808 14:40:38.680284 4931 raft_consensus.cc:3037] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:38.680284 4736 raft_consensus.cc:3037] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:38.681011 4736 raft_consensus.cc:2454] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12388afd747a4c638523625653a8267d in term 1.
I20260808 14:40:38.681172 4931 raft_consensus.cc:2454] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12388afd747a4c638523625653a8267d in term 1.
I20260808 14:40:38.681384 5019 leader_election.cc:302] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12388afd747a4c638523625653a8267d, 700fa60a5a374b0698e7b1ec7d86ade6; no voters:
I20260808 14:40:38.681481 5210 raft_consensus.cc:2781] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:38.681638 5210 raft_consensus.cc:686] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 1 LEADER]: Becoming Leader. State: Replica: 12388afd747a4c638523625653a8267d, State: Running, Role: LEADER
I20260808 14:40:38.681735 5210 consensus_queue.cc:237] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } }
I20260808 14:40:38.682533 4533 catalog_manager.cc:5495] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d reported cstate change: term changed from 0 to 1, leader changed from <none> to 12388afd747a4c638523625653a8267d (127.29.168.195). New cstate: current_term: 1 leader_uuid: "12388afd747a4c638523625653a8267d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12388afd747a4c638523625653a8267d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 40749 } health_report { overall_health: HEALTHY } } }
I20260808 14:40:38.719280 5197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.718298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41248 (local address 127.29.168.195:40749)
0808 14:40:38.718358 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.718360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.718386 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:40:38.718426 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.718426 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.718441 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.718530 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.719038 (+ 508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.719040 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.719040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.719044 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.719058 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.719062 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.719114 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.719174 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.719188 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:38.721015 4736 raft_consensus.cc:1261] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 1 FOLLOWER]: Refusing update from remote peer 12388afd747a4c638523625653a8267d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:38.721068 4931 raft_consensus.cc:1261] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 1 FOLLOWER]: Refusing update from remote peer 12388afd747a4c638523625653a8267d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:38.721405 5217 consensus_queue.cc:1035] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [LEADER]: Connected to new peer: Peer: permanent_uuid: "700fa60a5a374b0698e7b1ec7d86ade6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:38.721524 5210 consensus_queue.cc:1035] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b464d965082c4fedb76badb655806867" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:38.725693 5225 mvcc.cc:205] Tried to move back new op lower bound from 7316275358598754304 to 7316275358441115648. Current Snapshot: MvccSnapshot[applied={T|T < 7316275358598754304 or (T in {7316275358598754304})}]
I20260808 14:40:38.725862 4533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:38.725957 4533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:38.726763 4533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b2ac59f79ac54ce6b7c6dc77e8d1a402: Sending DeleteTablet for 3 replicas of tablet bc095c93ce0d442f94585096de8ecab7
I20260808 14:40:38.727137 4708 tablet_service.cc:1514] Processing DeleteTablet for tablet bc095c93ce0d442f94585096de8ecab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:38 UTC) from {username='slave'} at 127.0.0.1:59932
I20260808 14:40:38.727243 5079 tablet_service.cc:1514] Processing DeleteTablet for tablet bc095c93ce0d442f94585096de8ecab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:38 UTC) from {username='slave'} at 127.0.0.1:41232
I20260808 14:40:38.727264 4904 tablet_service.cc:1514] Processing DeleteTablet for tablet bc095c93ce0d442f94585096de8ecab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:38 UTC) from {username='slave'} at 127.0.0.1:48014
I20260808 14:40:38.727494 5235 tablet_replica.cc:330] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6: stopping tablet replica
I20260808 14:40:38.727597 5235 raft_consensus.cc:2229] T bc095c93ce0d442f94585096de8ecab7 P 700fa60a5a374b0698e7b1ec7d86ade6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:38.727625 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 4625
I20260808 14:40:38.735018 5237 tablet_replica.cc:330] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: stopping tablet replica
I20260808 14:40:38.735212 5237 raft_consensus.cc:2229] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:38.735337 5237 raft_consensus.cc:2258] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:38.735412 5236 tablet_replica.cc:330] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: stopping tablet replica
I20260808 14:40:38.735543 5236 raft_consensus.cc:2229] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:38.735775 5236 raft_consensus.cc:2258] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:38.737871 5236 ts_tablet_manager.cc:1905] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:38.737871 5237 ts_tablet_manager.cc:1905] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:38.741495 5237 ts_tablet_manager.cc:1918] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:38.741590 5237 log.cc:1196] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/bc095c93ce0d442f94585096de8ecab7
I20260808 14:40:38.741853 5237 ts_tablet_manager.cc:1939] T bc095c93ce0d442f94585096de8ecab7 P b464d965082c4fedb76badb655806867: Deleting consensus metadata
I20260808 14:40:38.742278 5236 ts_tablet_manager.cc:1918] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:38.742352 5236 log.cc:1196] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/bc095c93ce0d442f94585096de8ecab7
I20260808 14:40:38.742322 4512 catalog_manager.cc:4841] TS b464d965082c4fedb76badb655806867 (127.29.168.194:43699): tablet bc095c93ce0d442f94585096de8ecab7 (table test-table [id=f555ba233fcc4f6aa3ac1159f8d7d003]) successfully deleted
I20260808 14:40:38.742616 5236 ts_tablet_manager.cc:1939] T bc095c93ce0d442f94585096de8ecab7 P 12388afd747a4c638523625653a8267d: Deleting consensus metadata
I20260808 14:40:38.743033 4512 catalog_manager.cc:4841] TS 12388afd747a4c638523625653a8267d (127.29.168.195:40749): tablet bc095c93ce0d442f94585096de8ecab7 (table test-table [id=f555ba233fcc4f6aa3ac1159f8d7d003]) successfully deleted
W20260808 14:40:38.746351 4513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:35209 (error 108)
I20260808 14:40:38.746663 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 4811
I20260808 14:40:38.749007 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.746774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:35209 (local address 127.0.0.1:59946)
0808 14:40:38.748893 (+ 2119us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.748959 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:35209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2066}
W20260808 14:40:38.752372 4513 catalog_manager.cc:4584] TS 700fa60a5a374b0698e7b1ec7d86ade6 (127.29.168.193:35209): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bc095c93ce0d442f94585096de8ecab7: Network error: Client connection negotiation failed: client connection to 127.29.168.193:35209: connect: Connection refused (error 111)
I20260808 14:40:38.765409 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 4990
I20260808 14:40:38.778566 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 4493
2026-08-08T14:40:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (756 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 14:40:38.802724 30371 mini_oidc.cc:152] Starting JWKS server
I20260808 14:40:38.804107 30371 webserver.cc:460] Webserver started at https://127.0.0.1:39043/ using document root <none> and password file <none>
I20260808 14:40:38.804188 30371 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:40:38.804380 30371 webserver.cc:460] Webserver started at http://127.0.0.1:41683/ using document root <none> and password file <none>
2026-08-08T14:40:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:38Z Disabled control of system clock
I20260808 14:40:38.812877 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45457
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:39709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:45457
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39043/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/testchainca.cert with env {}
W20260808 14:40:38.890767 5246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:38.890993 5246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:38.891016 5246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:38.892164 5246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:38.892206 5246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:38.892222 5246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:38.892237 5246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:38.892249 5246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:40:38.892262 5246 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:40:38.892274 5246 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39043/jwks.json
I20260808 14:40:38.893769 5246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:45457
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39043/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:38.893966 5246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:38.894142 5246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:38.899004 5253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.898980 5252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:38.899027 5257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:38.899086 5246 server_base.cc:1034] running on GCE node
I20260808 14:40:38.899516 5246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:38.899835 5246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:38.901000 5246 hybrid_clock.cc:648] HybridClock initialized: now 1786200038900986 us; error 29 us; skew 500 ppm
I20260808 14:40:38.902277 5246 webserver.cc:460] Webserver started at http://127.29.168.254:40405/ using document root <none> and password file <none>
I20260808 14:40:38.902478 5246 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:38.902520 5246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:38.902601 5246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:38.903524 5246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "1eff1489f4a04e79a02f044e4f81c492"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "5e052ca467b35f869d3d9d172d1e78ed"
server_key_iv: "4aff1a9fd0941fba54283f8b115bf89d"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.903891 5246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "1eff1489f4a04e79a02f044e4f81c492"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "5e052ca467b35f869d3d9d172d1e78ed"
server_key_iv: "4aff1a9fd0941fba54283f8b115bf89d"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.905112 5246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:38.905781 5263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:38.905969 5246 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:38.906068 5246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "1eff1489f4a04e79a02f044e4f81c492"
format_stamp: "Formatted at 2026-08-08 14:40:38 on dist-test-slave-mjjr"
server_key: "5e052ca467b35f869d3d9d172d1e78ed"
server_key_iv: "4aff1a9fd0941fba54283f8b115bf89d"
server_key_version: "encryptionkey@0"
I20260808 14:40:38.906153 5246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:38.936223 5246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:38.936512 5246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:38.936663 5246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:38.940593 5246 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:45457
I20260808 14:40:38.940625 5340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:45457 every 8 connection(s)
I20260808 14:40:38.940950 5246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:38.942015 5341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:38.944269 5341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492: Bootstrap starting.
I20260808 14:40:38.944787 5341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:38.945050 5341 log.cc:824] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:38.945708 5341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492: No bootstrap required, opened a new log
I20260808 14:40:38.947326 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 5246
I20260808 14:40:38.947424 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:38.947301 5341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eff1489f4a04e79a02f044e4f81c492" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45457 } }
I20260808 14:40:38.947466 5341 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:38.947505 5341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eff1489f4a04e79a02f044e4f81c492, State: Initialized, Role: FOLLOWER
I20260808 14:40:38.947618 30371 external_mini_cluster.cc:1428] Setting key 742f068e4d9975acb717b73d073452c7
I20260808 14:40:38.947690 5341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eff1489f4a04e79a02f044e4f81c492" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45457 } }
I20260808 14:40:38.947785 5341 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:38.947817 5341 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:38.947885 5341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:38.948642 5341 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eff1489f4a04e79a02f044e4f81c492" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45457 } }
I20260808 14:40:38.948748 5341 leader_election.cc:302] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1eff1489f4a04e79a02f044e4f81c492; no voters:
I20260808 14:40:38.948889 5341 leader_election.cc:288] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:38.949007 5346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:38.949147 5346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [term 1 LEADER]: Becoming Leader. State: Replica: 1eff1489f4a04e79a02f044e4f81c492, State: Running, Role: LEADER
I20260808 14:40:38.949241 5346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eff1489f4a04e79a02f044e4f81c492" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45457 } }
I20260808 14:40:38.949138 5341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:38.949676 5348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eff1489f4a04e79a02f044e4f81c492. Latest consensus state: current_term: 1 leader_uuid: "1eff1489f4a04e79a02f044e4f81c492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eff1489f4a04e79a02f044e4f81c492" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45457 } } }
I20260808 14:40:38.949784 5348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:38.949962 5347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1eff1489f4a04e79a02f044e4f81c492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eff1489f4a04e79a02f044e4f81c492" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45457 } } }
I20260808 14:40:38.950023 5347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:38.950131 5350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:38.950659 5350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:38.952255 5350 catalog_manager.cc:1347] Generated new cluster ID: 466b57c6958b44688f2d5e3ff884c8e1
I20260808 14:40:38.952334 5350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:38.954586 5345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.948366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54172 (local address 127.29.168.254:45457)
0808 14:40:38.948600 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.948610 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.948659 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:40:38.948863 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.948871 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.948940 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.949313 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:38.949433 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:38.951214 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:38.952434 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:38.953054 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:38.953162 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:38.953886 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:38.953889 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:38.953890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:38.954084 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:38.954122 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:38.954135 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:38.954205 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:38.954305 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 14:40:38.954374 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260808 14:40:38.955461 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:38.959090 5350 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:38.959534 5350 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:38.966063 5350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1eff1489f4a04e79a02f044e4f81c492: Generated new TSK 0
I20260808 14:40:38.966215 5350 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:40:38.991725 5390 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 14:40:38.991865 5390 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:40:38.992036 5345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:38.978238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54180 (local address 127.29.168.254:45457)
0808 14:40:38.978292 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:38.978294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:38.978382 (+ 88us) server_negotiation.cc:407] Connection header received
0808 14:40:38.978483 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:38.978484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:38.978494 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:38.978552 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:40:38.978696 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:38.979141 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:38.979934 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:38.980119 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:38.980205 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:38.980408 (+ 203us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:40:38.991830 (+ 11422us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:40:38.991987 (+ 157us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54180: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 14:40:38.992062 5345 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54180: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 14:40:38.992398 5388 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:38.978145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45457 (local address 127.0.0.1:54180)
0808 14:40:38.978313 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:38.978322 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:38.978401 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:38.978558 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:38.978559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:38.978564 (+ 5us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:40:38.978624 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:38.978626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:38.979217 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:38.979218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:38.979857 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:38.979860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:38.980221 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:38.980222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:38.980288 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:38.980304 (+ 16us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:40:38.991956 (+ 11652us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:40:38.992060 (+ 104us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.168.254:45457: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.29.168.254:45457: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39043/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 14:40:38.992790 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 5246
2026-08-08T14:40:39Z chronyd exiting
I20260808 14:40:39.035241 30371 test_util.cc:175] -----------------------------------------------
I20260808 14:40:39.035331 30371 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200015623817-30371-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 14:40:39.036290 30371 mini_oidc.cc:152] Starting JWKS server
I20260808 14:40:39.036916 30371 webserver.cc:460] Webserver started at https://127.0.0.1:36483/ using document root <none> and password file <none>
I20260808 14:40:39.036974 30371 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:40:39.037133 30371 webserver.cc:460] Webserver started at http://127.0.0.1:41207/ using document root <none> and password file <none>
2026-08-08T14:40:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:39Z Disabled control of system clock
I20260808 14:40:39.044878 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:38313
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:38313
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36483/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/testchainca.cert with env {}
W20260808 14:40:39.121330 5398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:39.121554 5398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:39.121591 5398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:39.122702 5398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:39.122797 5398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:39.122822 5398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:39.122870 5398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:39.122893 5398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:40:39.122918 5398 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:40:39.122946 5398 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36483/jwks.json
I20260808 14:40:39.124441 5398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:38313
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:38313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36483/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:39.124696 5398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:39.124914 5398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:39.129498 5404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:39.129558 5403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:39.129660 5398 server_base.cc:1034] running on GCE node
W20260808 14:40:39.129499 5406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:39.129916 5398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:39.130187 5398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:39.131347 5398 hybrid_clock.cc:648] HybridClock initialized: now 1786200039131332 us; error 26 us; skew 500 ppm
I20260808 14:40:39.132524 5398 webserver.cc:460] Webserver started at http://127.29.168.254:40151/ using document root <none> and password file <none>
I20260808 14:40:39.132777 5398 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:39.132869 5398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:39.133016 5398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:39.133996 5398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "95cb6e36852d4ad782abf839eb9fbaaf"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "34aa9b4b1c4582c6caadef7afcf5f23a"
server_key_iv: "002428087cccaca70760a4a21d1e1455"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.134339 5398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "95cb6e36852d4ad782abf839eb9fbaaf"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "34aa9b4b1c4582c6caadef7afcf5f23a"
server_key_iv: "002428087cccaca70760a4a21d1e1455"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.135469 5398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:39.136251 5415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:39.136425 5398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:39.136519 5398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "95cb6e36852d4ad782abf839eb9fbaaf"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "34aa9b4b1c4582c6caadef7afcf5f23a"
server_key_iv: "002428087cccaca70760a4a21d1e1455"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.136608 5398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:39.154702 5398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:39.154980 5398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:39.155117 5398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:39.159288 5398 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:38313
I20260808 14:40:39.159307 5485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:38313 every 8 connection(s)
I20260808 14:40:39.159626 5398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:39.160291 5487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:39.162629 5487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf: Bootstrap starting.
I20260808 14:40:39.163134 5487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:39.163368 5487 log.cc:824] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:39.164072 5487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf: No bootstrap required, opened a new log
I20260808 14:40:39.165501 5487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38313 } }
I20260808 14:40:39.165622 5487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:39.165642 5487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95cb6e36852d4ad782abf839eb9fbaaf, State: Initialized, Role: FOLLOWER
I20260808 14:40:39.165766 5487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38313 } }
I20260808 14:40:39.165848 5487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:39.165869 5487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:39.165894 5487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:39.166328 5487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38313 } }
I20260808 14:40:39.166414 5487 leader_election.cc:302] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95cb6e36852d4ad782abf839eb9fbaaf; no voters:
I20260808 14:40:39.166571 5487 leader_election.cc:288] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:39.166640 5491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:39.166807 5491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [term 1 LEADER]: Becoming Leader. State: Replica: 95cb6e36852d4ad782abf839eb9fbaaf, State: Running, Role: LEADER
I20260808 14:40:39.166819 5487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:39.166926 5491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38313 } }
I20260808 14:40:39.167255 5492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38313 } } }
I20260808 14:40:39.167346 5492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:39.167393 5493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95cb6e36852d4ad782abf839eb9fbaaf. Latest consensus state: current_term: 1 leader_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95cb6e36852d4ad782abf839eb9fbaaf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 38313 } } }
I20260808 14:40:39.167444 5493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:39.167654 5504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:39.168171 5504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:39.169549 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 5398
I20260808 14:40:39.169670 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:39.169685 5504 catalog_manager.cc:1347] Generated new cluster ID: 65225287ab9547b9b34134237a2aff62
I20260808 14:40:39.169731 5504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:39.169860 30371 external_mini_cluster.cc:1428] Setting key 1e80b161366fa8ece087c550d6dfd810
I20260808 14:40:39.175727 5520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:39.170458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32866 (local address 127.29.168.254:38313)
0808 14:40:39.170602 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:39.170620 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:39.170643 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:40:39.170753 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:39.170759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:39.170813 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:39.170925 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:39.171195 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.172509 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.173612 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.174222 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.174324 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.175009 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:39.175013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:39.175013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:39.175193 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:39.175233 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:39.175246 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:39.175307 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:39.175384 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:40:39.175532 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
I20260808 14:40:39.176681 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:39.185256 5504 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:39.185653 5504 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:39.191213 5504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95cb6e36852d4ad782abf839eb9fbaaf: Generated new TSK 0
I20260808 14:40:39.191370 5504 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:40:39.211709 5530 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 14:40:39.211776 5530 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:40:39.212056 5520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:39.198279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32872 (local address 127.29.168.254:38313)
0808 14:40:39.198315 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:39.198316 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:39.198478 (+ 162us) server_negotiation.cc:407] Connection header received
0808 14:40:39.198539 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:39.198540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:39.198548 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:39.198595 (+ 47us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:40:39.198707 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.199155 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.200282 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.200456 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.200505 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.200700 (+ 195us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:40:39.211893 (+ 11193us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36483/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:40:39.212007 (+ 114us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32872: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36483/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:40:39.212117 5520 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32872: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36483/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 14:40:39.212306 5527 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:39.198254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:38313 (local address 127.0.0.1:32872)
0808 14:40:39.198399 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:39.198411 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:39.198479 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:39.198604 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:39.198604 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:39.198606 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:40:39.198658 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:39.198659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.199226 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.199227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:39.200194 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:39.200197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.200546 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.200547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:39.200609 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.200615 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:40:39.211989 (+ 11374us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36483/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:40:39.212192 (+ 203us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.168.254:38313: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36483/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260808 14:40:39.212590 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 5398
2026-08-08T14:40:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (220 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 14:40:39.256337 30371 mini_oidc.cc:152] Starting JWKS server
I20260808 14:40:39.256989 30371 webserver.cc:460] Webserver started at https://127.0.0.1:33767/ using document root <none> and password file <none>
I20260808 14:40:39.257031 30371 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:40:39.257198 30371 webserver.cc:460] Webserver started at http://127.0.0.1:40245/ using document root <none> and password file <none>
2026-08-08T14:40:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:39Z Disabled control of system clock
I20260808 14:40:39.265820 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:35937
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:37615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:35937
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33767/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:40:39.343068 5541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:39.343258 5541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:39.343281 5541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:39.344429 5541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:39.344468 5541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:39.344481 5541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:39.344492 5541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:39.344504 5541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:40:39.344553 5541 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:40:39.344569 5541 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33767/jwks.json
I20260808 14:40:39.345834 5541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:37615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:35937
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:35937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33767/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:39.346058 5541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:39.346350 5541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:39.350947 5553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:39.350955 5551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:39.350987 5541 server_base.cc:1034] running on GCE node
W20260808 14:40:39.350955 5549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:39.351356 5541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:39.351624 5541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:39.352836 5541 hybrid_clock.cc:648] HybridClock initialized: now 1786200039352814 us; error 37 us; skew 500 ppm
I20260808 14:40:39.354174 5541 webserver.cc:460] Webserver started at http://127.29.168.254:44051/ using document root <none> and password file <none>
I20260808 14:40:39.354414 5541 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:39.354460 5541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:39.354620 5541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:39.355613 5541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "570ecf848f7e4418bb11f735d823cce2"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "6d3e0e516201f61e8bd93505d21dea1e"
server_key_iv: "f1106e91a0064a497d0417d26572a847"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.356019 5541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "570ecf848f7e4418bb11f735d823cce2"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "6d3e0e516201f61e8bd93505d21dea1e"
server_key_iv: "f1106e91a0064a497d0417d26572a847"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.357204 5541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:39.357901 5561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:39.358054 5541 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:39.358150 5541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "570ecf848f7e4418bb11f735d823cce2"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "6d3e0e516201f61e8bd93505d21dea1e"
server_key_iv: "f1106e91a0064a497d0417d26572a847"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.358237 5541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:39.374430 5541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:39.374687 5541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:39.374830 5541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:39.378485 5541 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:35937
I20260808 14:40:39.378513 5631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:35937 every 8 connection(s)
I20260808 14:40:39.378803 5541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:39.379436 5633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:39.380093 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 5541
I20260808 14:40:39.380193 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:39.380406 30371 external_mini_cluster.cc:1428] Setting key 4714247b482bdc34a1f31f2ff837c034
I20260808 14:40:39.382880 5633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2: Bootstrap starting.
I20260808 14:40:39.383571 5633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:39.383900 5633 log.cc:824] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:39.384575 5633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2: No bootstrap required, opened a new log
I20260808 14:40:39.386016 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:39.380899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.29.168.254:35937)
0808 14:40:39.381100 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:39.381108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:39.381137 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:40:39.381632 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:39.381646 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:39.381720 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:39.381870 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:39.382070 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.383332 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.384215 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.384598 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.384715 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.385432 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:39.385435 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:39.385436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:39.385583 (+ 147us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:39.385612 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:39.385621 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:39.385691 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:39.385793 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 14:40:39.385869 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":57,"threads_started":1}
I20260808 14:40:39.386801 5633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570ecf848f7e4418bb11f735d823cce2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 35937 } }
I20260808 14:40:39.386947 5633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:39.386984 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:39.386996 5633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570ecf848f7e4418bb11f735d823cce2, State: Initialized, Role: FOLLOWER
I20260808 14:40:39.387115 5633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570ecf848f7e4418bb11f735d823cce2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 35937 } }
I20260808 14:40:39.387189 5633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:39.387210 5633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:39.387249 5633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:39.387815 5633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570ecf848f7e4418bb11f735d823cce2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 35937 } }
I20260808 14:40:39.387894 5633 leader_election.cc:302] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 570ecf848f7e4418bb11f735d823cce2; no voters:
I20260808 14:40:39.388028 5633 leader_election.cc:288] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:39.388068 5642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:39.388180 5642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [term 1 LEADER]: Becoming Leader. State: Replica: 570ecf848f7e4418bb11f735d823cce2, State: Running, Role: LEADER
I20260808 14:40:39.388259 5633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:39.388250 5642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570ecf848f7e4418bb11f735d823cce2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 35937 } }
I20260808 14:40:39.388640 5645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 570ecf848f7e4418bb11f735d823cce2. Latest consensus state: current_term: 1 leader_uuid: "570ecf848f7e4418bb11f735d823cce2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570ecf848f7e4418bb11f735d823cce2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 35937 } } }
I20260808 14:40:39.388707 5645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:39.388880 5646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "570ecf848f7e4418bb11f735d823cce2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "570ecf848f7e4418bb11f735d823cce2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 35937 } } }
I20260808 14:40:39.388940 5646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:39.389189 5653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:39.389642 5653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:39.391083 5653 catalog_manager.cc:1347] Generated new cluster ID: 19bc664a880d48049ae90f77d48976f0
I20260808 14:40:39.391121 5653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:39.396034 5653 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:39.396529 5653 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:39.399910 5653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 570ecf848f7e4418bb11f735d823cce2: Generated new TSK 0
I20260808 14:40:39.400071 5653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:39.413687 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:39.410005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52658 (local address 127.29.168.254:35937)
0808 14:40:39.410058 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:39.410060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:39.410167 (+ 107us) server_negotiation.cc:407] Connection header received
0808 14:40:39.410219 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:39.410220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:39.410230 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:39.410303 (+ 73us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:40:39.410430 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.411147 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.411978 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.412308 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.412402 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.412589 (+ 187us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:40:39.413501 (+ 912us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33767/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:40:39.413625 (+ 124us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52658: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33767/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 14:40:39.413733 5639 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52658: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33767/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 14:40:39.413803 5678 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:39.409913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:35937 (local address 127.0.0.1:52658)
0808 14:40:39.410086 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:39.410097 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:39.410165 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:39.410320 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:39.410320 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:39.410322 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:40:39.410366 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:39.410367 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.411259 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.411260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:39.411903 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:39.411906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.412416 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.412417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:39.412457 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.412462 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:40:39.413606 (+ 1144us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33767/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:40:39.413704 (+ 98us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.168.254:35937: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33767/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
I20260808 14:40:39.413955 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 5541
E20260808 14:40:39.433072 5679 webserver.cc:533] Webserver: sslize failed:
E20260808 14:40:39.433141 5679 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T14:40:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (204 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T14:40:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:39Z Disabled control of system clock
I20260808 14:40:39.468962 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41123
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:34963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41123
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/testchainca.cert with env {}
W20260808 14:40:39.547006 5684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:39.547183 5684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:39.547205 5684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:39.548275 5684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:39.548309 5684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:39.548322 5684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:39.548334 5684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:39.548346 5684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:40:39.548358 5684 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:40:39.548369 5684 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 14:40:39.549765 5684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41123
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:39.549940 5684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:39.550086 5684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:39.554801 5693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:39.554769 5696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:39.554783 5692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:39.554913 5684 server_base.cc:1034] running on GCE node
I20260808 14:40:39.555231 5684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:39.555502 5684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:39.556670 5684 hybrid_clock.cc:648] HybridClock initialized: now 1786200039556653 us; error 29 us; skew 500 ppm
I20260808 14:40:39.557889 5684 webserver.cc:460] Webserver started at http://127.29.168.254:34293/ using document root <none> and password file <none>
I20260808 14:40:39.558131 5684 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:39.558175 5684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:39.558336 5684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:39.559298 5684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "ffd0b45583e94ee3ace06948f47c9c88"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "3a5d718589a2b02b677d13fef2cf6e4d"
server_key_iv: "019618c21d78a982f3c8acdc2a4cd95e"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.559628 5684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "ffd0b45583e94ee3ace06948f47c9c88"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "3a5d718589a2b02b677d13fef2cf6e4d"
server_key_iv: "019618c21d78a982f3c8acdc2a4cd95e"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.561050 5684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:39.561780 5702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:39.561937 5684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:39.562033 5684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "ffd0b45583e94ee3ace06948f47c9c88"
format_stamp: "Formatted at 2026-08-08 14:40:39 on dist-test-slave-mjjr"
server_key: "3a5d718589a2b02b677d13fef2cf6e4d"
server_key_iv: "019618c21d78a982f3c8acdc2a4cd95e"
server_key_version: "encryptionkey@0"
I20260808 14:40:39.562124 5684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:39.580461 5684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:39.580708 5684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:39.580858 5684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:39.584492 5684 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41123
I20260808 14:40:39.584532 5776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41123 every 8 connection(s)
I20260808 14:40:39.584820 5684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:39.585753 5777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:39.587880 5777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88: Bootstrap starting.
I20260808 14:40:39.588399 5777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:39.588634 5777 log.cc:824] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:39.589229 5777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88: No bootstrap required, opened a new log
I20260808 14:40:39.590714 5777 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b45583e94ee3ace06948f47c9c88" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41123 } }
I20260808 14:40:39.590831 5777 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:39.590852 5777 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd0b45583e94ee3ace06948f47c9c88, State: Initialized, Role: FOLLOWER
I20260808 14:40:39.590986 5777 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b45583e94ee3ace06948f47c9c88" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41123 } }
I20260808 14:40:39.591075 5777 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:39.591096 5777 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:39.591121 5777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:39.591562 5777 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b45583e94ee3ace06948f47c9c88" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41123 } }
I20260808 14:40:39.591683 5777 leader_election.cc:302] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffd0b45583e94ee3ace06948f47c9c88; no voters:
I20260808 14:40:39.591813 5777 leader_election.cc:288] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:39.591869 5782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:39.592029 5782 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [term 1 LEADER]: Becoming Leader. State: Replica: ffd0b45583e94ee3ace06948f47c9c88, State: Running, Role: LEADER
I20260808 14:40:39.592041 5777 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:39.592123 5782 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b45583e94ee3ace06948f47c9c88" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41123 } }
I20260808 14:40:39.592437 5783 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffd0b45583e94ee3ace06948f47c9c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b45583e94ee3ace06948f47c9c88" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41123 } } }
I20260808 14:40:39.592546 5783 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:39.592568 5784 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffd0b45583e94ee3ace06948f47c9c88. Latest consensus state: current_term: 1 leader_uuid: "ffd0b45583e94ee3ace06948f47c9c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b45583e94ee3ace06948f47c9c88" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41123 } } }
I20260808 14:40:39.592639 5784 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:39.592780 5793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:39.593376 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 5684
I20260808 14:40:39.593489 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:39.593678 30371 external_mini_cluster.cc:1428] Setting key 10775bafa3889a014d5739d4d8e54467
I20260808 14:40:39.593955 5793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:39.595721 5793 catalog_manager.cc:1347] Generated new cluster ID: 165f074ba8bd4b978c9bf81bae3d67bf
I20260808 14:40:39.595777 5793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:39.599843 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:39.594547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58842 (local address 127.29.168.254:41123)
0808 14:40:39.594724 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:39.594733 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:39.594764 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:40:39.594880 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:39.594886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:39.594945 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:39.595074 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:39.595421 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.596778 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.597916 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.598459 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.598565 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.599175 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:39.599179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:39.599179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:40:39.599355 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:39.599390 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:40:39.599402 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:39.599461 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:39.599549 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:40:39.599611 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260808 14:40:39.600638 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:40:39.610638 5793 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:39.611025 5793 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:39.614130 5793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffd0b45583e94ee3ace06948f47c9c88: Generated new TSK 0
I20260808 14:40:39.614291 5793 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:40.520110 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:39.621304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58854 (local address 127.29.168.254:41123)
0808 14:40:39.621342 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:39.621343 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:39.621448 (+ 105us) server_negotiation.cc:407] Connection header received
0808 14:40:39.621511 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:39.621512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:39.621522 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:39.621582 (+ 60us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:40:39.621691 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.622400 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.623131 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.623450 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.623515 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.623680 (+ 165us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:40:40.519773 (+896093us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:40:40.520011 (+ 238us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58854: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:40:40.520190 5810 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58854: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 14:40:40.520226 5817 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:39.621241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41123 (local address 127.0.0.1:58854)
0808 14:40:39.621368 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:39.621378 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:39.621435 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:39.621586 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:39.621587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:39.621588 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:40:39.621627 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:39.621628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.622465 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.622465 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:39.623043 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:39.623044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:39.623533 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:39.623534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:39.623572 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:39.623576 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:40:40.519956 (+896380us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:40:40.520112 (+ 156us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.168.254:41123: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260808 14:40:40.520514 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 5684
2026-08-08T14:40:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1084 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (87 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (86 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:40 dist-test-slave-mjjr krb5kdc[5831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:40 dist-test-slave-mjjr krb5kdc[5831](info): set up 2 sockets
Aug 08 14:40:40 dist-test-slave-mjjr krb5kdc[5831](info): commencing operation
krb5kdc: starting...
W20260808 14:40:41.952478 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 14:40:42.103266 30371 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.151s user 0.001s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 14:40:42.293385 30371 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.190s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 14:40:42.421404 30371 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.128s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/test-user.keytab.
W20260808 14:40:42.940172 30371 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.519s user 0.001s sys 0.001s
Aug 08 14:40:42 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
W20260808 14:40:43.322247 30371 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.29.168.254: real 0.360s user 0.001s sys 0.003s
I20260808 14:40:43.322666 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41625
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:43.402558 5859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:43.402733 5859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:43.402753 5859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:43.403864 5859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:43.403898 5859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:43.403913 5859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:43.403924 5859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:43.403936 5859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:43.405228 5859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:43.405398 5859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:43.405563 5859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:43.410267 5868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:43.410256 5870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:43.410424 5859 server_base.cc:1034] running on GCE node
W20260808 14:40:43.410272 5867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:43.410730 5859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:43.410998 5859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:43.412133 5859 hybrid_clock.cc:648] HybridClock initialized: now 1786200043412114 us; error 34 us; skew 500 ppm
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.417040 5859 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:43.417424 5859 webserver.cc:460] Webserver started at http://127.29.168.254:45267/ using document root <none> and password file <none>
I20260808 14:40:43.417658 5859 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:43.417701 5859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:43.417840 5859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:43.418730 5859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "00cbff34c26742aabbf1d1f9c4a221b5"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "c1b0f20c67b53b2499cd2962a702b14f"
server_key_iv: "b26950fc90bba330880f974f0c140889"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.419051 5859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "00cbff34c26742aabbf1d1f9c4a221b5"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "c1b0f20c67b53b2499cd2962a702b14f"
server_key_iv: "b26950fc90bba330880f974f0c140889"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.420368 5859 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:40:43.421000 5878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.421162 5859 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:43.421236 5859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "00cbff34c26742aabbf1d1f9c4a221b5"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "c1b0f20c67b53b2499cd2962a702b14f"
server_key_iv: "b26950fc90bba330880f974f0c140889"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.421288 5859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:43.434913 5859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:43.436582 5859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:43.436679 5859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:43.440584 5859 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41625
I20260808 14:40:43.440655 5964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41625 every 8 connection(s)
I20260808 14:40:43.440963 5859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:43.441771 5965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:43.443758 5965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5: Bootstrap starting.
I20260808 14:40:43.444274 5965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:43.444533 5965 log.cc:824] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:43.445116 5965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5: No bootstrap required, opened a new log
I20260808 14:40:43.446547 5965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41625 } }
I20260808 14:40:43.446671 5965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:43.446693 5965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cbff34c26742aabbf1d1f9c4a221b5, State: Initialized, Role: FOLLOWER
I20260808 14:40:43.446784 5965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41625 } }
I20260808 14:40:43.446874 5965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:43.446914 5965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:43.446967 5965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:43.447475 5965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41625 } }
I20260808 14:40:43.447597 5965 leader_election.cc:302] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00cbff34c26742aabbf1d1f9c4a221b5; no voters:
I20260808 14:40:43.447818 5965 leader_election.cc:288] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:43.447867 5969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:43.448091 5965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:43.448082 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 5859
I20260808 14:40:43.448176 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:43.448243 5969 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [term 1 LEADER]: Becoming Leader. State: Replica: 00cbff34c26742aabbf1d1f9c4a221b5, State: Running, Role: LEADER
I20260808 14:40:43.448391 30371 external_mini_cluster.cc:1428] Setting key eb9ad8264d9f110eb3e703488d289b65
I20260808 14:40:43.448395 5969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41625 } }
I20260808 14:40:43.448736 5970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41625 } } }
I20260808 14:40:43.448812 5970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:43.448968 5972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00cbff34c26742aabbf1d1f9c4a221b5. Latest consensus state: current_term: 1 leader_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00cbff34c26742aabbf1d1f9c4a221b5" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41625 } } }
I20260808 14:40:43.449024 5972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:43.449265 5982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:43.449759 5982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:43.451246 5982 catalog_manager.cc:1347] Generated new cluster ID: 04356dded5b34defb409dae537e4ce44
I20260808 14:40:43.451300 5982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:43.459626 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.448977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58004 (local address 127.29.168.254:41625)
0808 14:40:43.449400 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.449408 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.449437 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:40:43.449551 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.449558 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.449615 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.449737 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.450542 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.451820 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.452845 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.453464 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.453577 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.456280 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:43.456283 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:43.456284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:43.456310 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:43.458123 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.458512 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.458514 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.458515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.458608 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.458810 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.458811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.458811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.459062 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:43.459207 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:43.459311 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:40:43.459421 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":77,"threads_started":1}
I20260808 14:40:43.469017 5982 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:43.469430 5982 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:43.472545 5982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00cbff34c26742aabbf1d1f9c4a221b5: Generated new TSK 0
I20260808 14:40:43.472699 5982 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:43.505910 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41625
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:43.592641 6000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:43.592821 6000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:43.592841 6000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:43.593930 6000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:43.593964 6000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:43.593989 6000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:43.595309 6000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:43.595479 6000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:43.595646 6000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:43.600229 6010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:43.600229 6007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:43.600306 6000 server_base.cc:1034] running on GCE node
W20260808 14:40:43.600287 6006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:43.600696 6000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:43.600929 6000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:43.602104 6000 hybrid_clock.cc:648] HybridClock initialized: now 1786200043602090 us; error 46 us; skew 500 ppm
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.604521 6000 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:43.604910 6000 webserver.cc:460] Webserver started at http://127.29.168.193:41171/ using document root <none> and password file <none>
I20260808 14:40:43.605129 6000 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:43.605193 6000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:43.605343 6000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:43.606312 6000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "cbd7f3b076f44ac692f319125bc995f8"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "ac5ca7bc0d2ee3859cab52b8bcc175d1"
server_key_iv: "cb802a85718727e136625f8cca5572ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.606719 6000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "cbd7f3b076f44ac692f319125bc995f8"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "ac5ca7bc0d2ee3859cab52b8bcc175d1"
server_key_iv: "cb802a85718727e136625f8cca5572ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.608067 6000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:43.608716 6021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.608873 6000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.608960 6000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "cbd7f3b076f44ac692f319125bc995f8"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "ac5ca7bc0d2ee3859cab52b8bcc175d1"
server_key_iv: "cb802a85718727e136625f8cca5572ef"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.609035 6000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:43.633822 6000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:43.635579 6000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:43.635756 6000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:43.635972 6000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:43.636265 6000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:43.636317 6000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.636354 6000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:43.636379 6000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.641917 6000 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:39033
I20260808 14:40:43.641985 6184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:39033 every 8 connection(s)
I20260808 14:40:43.642267 6000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:43.651165 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 6000
I20260808 14:40:43.651280 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:43.651346 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.642966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:59545 (local address 127.29.168.254:41625)
0808 14:40:43.643008 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.643010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.643175 (+ 165us) server_negotiation.cc:407] Connection header received
0808 14:40:43.644224 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.644225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.644241 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.644294 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.644874 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.645314 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.646162 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.646346 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.646433 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.648557 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:43.648559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:43.648559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:43.648566 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:43.649863 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.650288 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.650289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.650289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.650336 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.650671 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.650672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.650673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.650799 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:43.650884 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:43.651149 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 14:40:43.651237 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:43.651463 30371 external_mini_cluster.cc:1428] Setting key 86768d962704c9afb681789296eb5ffb
I20260808 14:40:43.651479 6188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.642923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41625 (local address 127.29.168.193:59545)
0808 14:40:43.643055 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:43.643098 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:43.644115 (+ 1017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:43.644360 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:43.644364 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:43.644623 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:43.644778 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:43.644781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.645408 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.645409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:43.646076 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:43.646077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.646442 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.646443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:43.646589 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.647066 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:43.647074 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:43.648471 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:43.649968 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:43.649975 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:43.649977 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:43.650207 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:43.650407 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:43.650408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:43.650408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:43.650522 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:43.650890 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:43.650895 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:43.650998 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 14:40:43.651084 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:40:43.651194 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260808 14:40:43.652308 6185 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41625
I20260808 14:40:43.652412 6185 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:43.652606 6185 heartbeater.cc:511] Master 127.29.168.254:41625 requested a full tablet report, sending...
I20260808 14:40:43.653087 5905 ts_manager.cc:194] Registered new tserver with Master: cbd7f3b076f44ac692f319125bc995f8 (127.29.168.193:39033)
I20260808 14:40:43.653708 5905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:59545
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:43.676158 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41625
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:43.756091 6194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:43.756307 6194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:43.756346 6194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:43.757457 6194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:43.757520 6194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:43.757560 6194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:43.758924 6194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:43.759193 6194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:43.759407 6194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:43.764024 6202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:43.764168 6206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:43.764024 6200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:43.764308 6194 server_base.cc:1034] running on GCE node
I20260808 14:40:43.764539 6194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:43.764782 6194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:43.766000 6194 hybrid_clock.cc:648] HybridClock initialized: now 1786200043765991 us; error 40 us; skew 500 ppm
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.768535 6194 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:43.768898 6194 webserver.cc:460] Webserver started at http://127.29.168.194:33123/ using document root <none> and password file <none>
I20260808 14:40:43.769074 6194 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:43.769111 6194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:43.769192 6194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:43.770090 6194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "c8e35c4be55d4167aa825ffaed3a2c48"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "6233ca1a4165e257ae5db91cd3d3d824"
server_key_iv: "877b18f9e2edb0a76a198773186d370a"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.770411 6194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "c8e35c4be55d4167aa825ffaed3a2c48"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "6233ca1a4165e257ae5db91cd3d3d824"
server_key_iv: "877b18f9e2edb0a76a198773186d370a"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.771524 6194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:43.772258 6215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.772449 6194 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.772548 6194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "c8e35c4be55d4167aa825ffaed3a2c48"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "6233ca1a4165e257ae5db91cd3d3d824"
server_key_iv: "877b18f9e2edb0a76a198773186d370a"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.772629 6194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:43.782876 6194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:43.784742 6194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:43.784893 6194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:43.785099 6194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:43.785382 6194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:43.785414 6194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.785434 6194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:43.785478 6194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.791033 6194 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:44451
I20260808 14:40:43.791102 6373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:44451 every 8 connection(s)
I20260808 14:40:43.791373 6194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:43.799758 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.792134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:54221 (local address 127.29.168.254:41625)
0808 14:40:43.792196 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.792198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.792380 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:40:43.793303 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.793304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.793313 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.793369 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.793906 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.794388 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.795309 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.795470 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.795535 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.797471 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:43.797472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:43.797472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:43.797479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:43.798612 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.798963 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.798964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.798964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.799011 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.799212 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.799212 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.799213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.799313 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:43.799361 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:43.799573 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:40:43.799696 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:43.799883 6379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.792084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41625 (local address 127.29.168.194:54221)
0808 14:40:43.792243 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:43.792299 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:43.793174 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:43.793426 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:43.793429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:43.793656 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:43.793839 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:43.793843 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.794477 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.794478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:43.795237 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:43.795239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.795557 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.795557 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:43.795673 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.796139 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:43.796147 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:43.797392 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:43.798682 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:43.798688 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:43.798690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:43.798899 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:43.799069 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:43.799070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:43.799070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:43.799159 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:43.799367 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:43.799371 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:43.799469 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 14:40:43.799547 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:40:43.799722 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260808 14:40:43.800323 6376 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41625
I20260808 14:40:43.800405 6376 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:43.800580 6376 heartbeater.cc:511] Master 127.29.168.254:41625 requested a full tablet report, sending...
I20260808 14:40:43.800618 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 6194
I20260808 14:40:43.800733 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:43.800930 30371 external_mini_cluster.cc:1428] Setting key 4819e0306b4fc87d84779336f9f9f20e
I20260808 14:40:43.801039 5905 ts_manager.cc:194] Registered new tserver with Master: c8e35c4be55d4167aa825ffaed3a2c48 (127.29.168.194:44451)
I20260808 14:40:43.801522 5905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:54221
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:43.823972 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41625
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:43.903450 6385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:43.903625 6385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:43.903697 6385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:43.904799 6385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:43.904851 6385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:43.904875 6385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:43.906270 6385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:43.906447 6385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:43.906654 6385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:43.911357 6393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:43.911423 6390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:43.911531 6391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:43.911633 6385 server_base.cc:1034] running on GCE node
I20260808 14:40:43.911898 6385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:43.912111 6385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:43.913256 6385 hybrid_clock.cc:648] HybridClock initialized: now 1786200043913238 us; error 34 us; skew 500 ppm
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.915726 6385 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:43.916193 6385 webserver.cc:460] Webserver started at http://127.29.168.195:34605/ using document root <none> and password file <none>
I20260808 14:40:43.916431 6385 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:43.916474 6385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:43.916613 6385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:43.917567 6385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "e7b8d6d82d2d43f6bfe8888bf735980b"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "1e1d78f4fbebca86a7b979bc65d3684b"
server_key_iv: "2c5a47d458a3eabef1bddc950f8d8621"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.917917 6385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "e7b8d6d82d2d43f6bfe8888bf735980b"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "1e1d78f4fbebca86a7b979bc65d3684b"
server_key_iv: "2c5a47d458a3eabef1bddc950f8d8621"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.919173 6385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:43.919903 6402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.920068 6385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:43.920158 6385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "e7b8d6d82d2d43f6bfe8888bf735980b"
format_stamp: "Formatted at 2026-08-08 14:40:43 on dist-test-slave-mjjr"
server_key: "1e1d78f4fbebca86a7b979bc65d3684b"
server_key_iv: "2c5a47d458a3eabef1bddc950f8d8621"
server_key_version: "encryptionkey@0"
I20260808 14:40:43.920245 6385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:43.937623 6385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:43.939246 6385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:43.939397 6385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:43.939592 6385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:43.939886 6385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:43.939937 6385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.939975 6385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:43.939999 6385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:43.945920 6385 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:43357
I20260808 14:40:43.945953 6568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:43357 every 8 connection(s)
I20260808 14:40:43.946238 6385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:43.948071 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 6385
I20260808 14:40:43.948170 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:43.948390 30371 external_mini_cluster.cc:1428] Setting key 343752ded1c1e0ac8d9353964ff94261
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:43.955627 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.947011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:55105 (local address 127.29.168.254:41625)
0808 14:40:43.947086 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.947088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.947246 (+ 158us) server_negotiation.cc:407] Connection header received
0808 14:40:43.948292 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.948294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.948310 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.948387 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.949282 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.949957 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.950920 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.951118 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.951168 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.953187 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:43.953188 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:43.953188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:43.953194 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:43.954580 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.954929 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.954930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.954930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.954976 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.955183 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.955183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.955183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.955270 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:43.955315 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:43.955517 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 14:40:43.955571 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:40:43.955871 6573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.946940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41625 (local address 127.29.168.195:55105)
0808 14:40:43.947133 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:43.947173 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:43.948141 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:43.948469 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:43.948473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:43.948935 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:43.949194 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:43.949200 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.950044 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.950045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:43.950847 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:43.950850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.951191 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.951192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:43.951307 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.951822 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:43.951830 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:43.953108 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:43.954651 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:43.954656 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:43.954658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:43.954864 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:43.955033 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:43.955033 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:43.955034 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:43.955132 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:43.955320 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:43.955324 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:43.955417 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 14:40:43.955490 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:40:43.955591 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260808 14:40:43.956300 6569 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41625
I20260808 14:40:43.956403 6569 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:43.956583 6569 heartbeater.cc:511] Master 127.29.168.254:41625 requested a full tablet report, sending...
I20260808 14:40:43.956934 5905 ts_manager.cc:194] Registered new tserver with Master: e7b8d6d82d2d43f6bfe8888bf735980b (127.29.168.195:43357)
I20260808 14:40:43.957278 5905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:55105
I20260808 14:40:43.960179 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/test-admin.keytab.
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.975807 30371 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 14:40:43.977434 6579 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:43.976697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38698 (local address 127.29.168.193:39033)
0808 14:40:43.976868 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.976872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.976881 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:43.976916 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.976918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.976930 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.976995 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.977325 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38698: BlockingRecv error: recv got EOF from 127.0.0.1:38698 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
W20260808 14:40:43.977551 30371 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.978485 30371 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.979511 30371 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:43.986889 6579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.980052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38706 (local address 127.29.168.193:39033)
0808 14:40:43.980112 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.980114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.980123 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:43.980198 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.980199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.980210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.980267 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.980637 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.981289 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.981975 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.982265 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.982354 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.984381 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:43.984391 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:43.984391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:43.984398 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:43.985713 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.986052 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.986055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.986055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.986118 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.986311 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.986312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.986312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.986446 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:43.986618 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:43.986700 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:40:43.986775 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 14:40:43.988547 6579 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:43.988088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38708 (local address 127.29.168.193:39033)
0808 14:40:43.988163 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.988164 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.988189 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:40:43.988228 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.988229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.988237 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.988271 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.988504 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38708: BlockingRecv error: recv got EOF from 127.0.0.1:38708 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 14:40:43.988631 30371 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.989465 30371 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.990197 30371 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:43.996467 6579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.990631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38710 (local address 127.29.168.193:39033)
0808 14:40:43.990678 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.990680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.990737 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:40:43.990785 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.990785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.990793 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.990828 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.991114 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.991506 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.992209 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:43.992391 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:43.992440 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:43.994339 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:43.994340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:43.994340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:43.994346 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:43.995495 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.995873 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.995874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.995874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.995921 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:43.996067 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:43.996067 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:43.996067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:43.996136 (+ 69us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:43.996193 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:43.996277 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:40:43.996338 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260808 14:40:43.997741 6579 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:43.997363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38712 (local address 127.29.168.193:39033)
0808 14:40:43.997395 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:43.997396 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:43.997439 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:40:43.997491 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:43.997491 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:43.997497 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:43.997534 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:43.997716 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38712: BlockingRecv error: recv got EOF from 127.0.0.1:38712 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:40:43.997926 30371 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200015623817-30371-0/krb5kdc/krb5cc)
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.998767 30371 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:43.999503 30371 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:40:43 dist-test-slave-mjjr krb5kdc[5831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:40:44.005473 6579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:43.999982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38720 (local address 127.29.168.193:39033)
0808 14:40:44.000042 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:44.000043 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:44.000106 (+ 63us) server_negotiation.cc:407] Connection header received
0808 14:40:44.000143 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:44.000144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:44.000150 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:44.000202 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:44.000496 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:44.000905 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:44.001505 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:44.001650 (+ 145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:44.001692 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:44.003319 (+ 1627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:44.003320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:44.003320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:44.003335 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:44.004582 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:44.004863 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:44.004863 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:44.004863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:44.004905 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:44.005050 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:44.005050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:44.005050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:44.005120 (+ 70us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:44.005177 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:44.005269 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:40:44.005319 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:44.005944 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 6000
I20260808 14:40:44.020155 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 6194
I20260808 14:40:44.034803 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 6385
I20260808 14:40:44.043759 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 5859
2026-08-08T14:40:44Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3348 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:44 dist-test-slave-mjjr krb5kdc[6601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:44 dist-test-slave-mjjr krb5kdc[6601](info): set up 2 sockets
Aug 08 14:40:44 dist-test-slave-mjjr krb5kdc[6601](info): commencing operation
krb5kdc: starting...
W20260808 14:40:45.229522 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:45Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab.
Entry for principal oryx/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab.
I20260808 14:40:45.339198 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44939
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab
--principal=oryx/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44939
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:45.417167 6617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:45.417380 6617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:45.417416 6617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:45.418408 6617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:45.418449 6617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:45.418462 6617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:45.418473 6617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:45.418483 6617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:45.419715 6617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab
--principal=oryx/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:45.419872 6617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:45.420008 6617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:45.424547 6629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.424631 6626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:45.424559 6617 server_base.cc:1034] running on GCE node
W20260808 14:40:45.424567 6622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:45.425071 6617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:45.425292 6617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:45.426429 6617 hybrid_clock.cc:648] HybridClock initialized: now 1786200045426418 us; error 28 us; skew 500 ppm
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:45.428812 6617 init.cc:377] Logged in from keytab as oryx/127.29.168.254@KRBTEST.COM (short username oryx)
I20260808 14:40:45.429214 6617 webserver.cc:460] Webserver started at http://127.29.168.254:39297/ using document root <none> and password file <none>
I20260808 14:40:45.429427 6617 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:45.429489 6617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:45.429629 6617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:45.430553 6617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "bf85c793f92346ac8d36e21f8de1ea17"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "31beb81e94438ab7ad4280aded4df46b"
server_key_iv: "461c09d3932bf54d2cd6b9fbf616b45f"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.430928 6617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "bf85c793f92346ac8d36e21f8de1ea17"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "31beb81e94438ab7ad4280aded4df46b"
server_key_iv: "461c09d3932bf54d2cd6b9fbf616b45f"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.432261 6617 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:45.432924 6639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.433100 6617 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:45.433194 6617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "bf85c793f92346ac8d36e21f8de1ea17"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "31beb81e94438ab7ad4280aded4df46b"
server_key_iv: "461c09d3932bf54d2cd6b9fbf616b45f"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.433271 6617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:45.447533 6617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:45.449355 6617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:45.449523 6617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:45.453855 6617 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:44939
I20260808 14:40:45.453884 6718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:44939 every 8 connection(s)
I20260808 14:40:45.454231 6617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:45.455181 6719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:45.457185 6719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Bootstrap starting.
I20260808 14:40:45.457657 6719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:45.457882 6719 log.cc:824] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:45.458475 6719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: No bootstrap required, opened a new log
I20260808 14:40:45.459823 6719 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } }
I20260808 14:40:45.459933 6719 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:45.459952 6719 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf85c793f92346ac8d36e21f8de1ea17, State: Initialized, Role: FOLLOWER
I20260808 14:40:45.460064 6719 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } }
I20260808 14:40:45.460134 6719 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:45.460153 6719 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:45.460176 6719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:45.460814 6719 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } }
I20260808 14:40:45.460887 6719 leader_election.cc:302] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf85c793f92346ac8d36e21f8de1ea17; no voters:
I20260808 14:40:45.461040 6719 leader_election.cc:288] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:45.461062 6722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:45.461169 6722 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 LEADER]: Becoming Leader. State: Replica: bf85c793f92346ac8d36e21f8de1ea17, State: Running, Role: LEADER
I20260808 14:40:45.461251 6722 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } }
I20260808 14:40:45.461273 6719 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:45.461548 6723 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf85c793f92346ac8d36e21f8de1ea17. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } }
I20260808 14:40:45.461818 6723 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:45.461738 6724 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } }
I20260808 14:40:45.462136 6724 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:45.462157 6732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:45.462767 6732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:45.463267 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 6617
I20260808 14:40:45.463382 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:45.463583 30371 external_mini_cluster.cc:1428] Setting key 1b949234be69a09d8768aa87c767de41
I20260808 14:40:45.464560 6732 catalog_manager.cc:1347] Generated new cluster ID: 77744ce3de4346f297104d0087817ddd
I20260808 14:40:45.464636 6732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:45.476120 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.464066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38820 (local address 127.29.168.254:44939)
0808 14:40:45.464269 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:45.464277 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:45.464863 (+ 586us) server_negotiation.cc:407] Connection header received
0808 14:40:45.464994 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:45.465001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:45.465057 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:45.465185 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:45.466181 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.467632 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.468694 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.469446 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.469551 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.472256 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:45.472261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:45.472261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:45.472274 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:45.474160 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.474584 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.474587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.474588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.474705 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.474897 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.474898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.474899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.475164 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:45.475313 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:45.475768 (+ 455us) server_negotiation.cc:299] Negotiation successful
0808 14:40:45.475912 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260808 14:40:45.478169 6732 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:45.478820 6732 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:45.481899 6732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Generated new TSK 0
I20260808 14:40:45.482038 6732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab.
Entry for principal oryx/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab.
I20260808 14:40:45.514413 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44939
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:45.599188 6766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:45.599359 6766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:45.599378 6766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:45.600443 6766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:45.600481 6766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:45.600505 6766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:45.601987 6766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:45.602241 6766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:45.602465 6766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:45.607987 6776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.607976 6775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.608011 6778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:45.608208 6766 server_base.cc:1034] running on GCE node
I20260808 14:40:45.608412 6766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:45.608632 6766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:45.609802 6766 hybrid_clock.cc:648] HybridClock initialized: now 1786200045609791 us; error 26 us; skew 500 ppm
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:45.612111 6766 init.cc:377] Logged in from keytab as oryx/127.29.168.193@KRBTEST.COM (short username oryx)
I20260808 14:40:45.612452 6766 webserver.cc:460] Webserver started at http://127.29.168.193:34375/ using document root <none> and password file <none>
I20260808 14:40:45.612624 6766 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:45.612658 6766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:45.612747 6766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:45.613622 6766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "18527c8589eb47a5907b96c58659e3fe"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "4165673fbb62664e2c257a0c84e245c3"
server_key_iv: "b65ac816de229f2af7ae177b26b4b08a"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.613926 6766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "18527c8589eb47a5907b96c58659e3fe"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "4165673fbb62664e2c257a0c84e245c3"
server_key_iv: "b65ac816de229f2af7ae177b26b4b08a"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.615257 6766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:40:45.616029 6790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.616178 6766 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.616262 6766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "18527c8589eb47a5907b96c58659e3fe"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "4165673fbb62664e2c257a0c84e245c3"
server_key_iv: "b65ac816de229f2af7ae177b26b4b08a"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.616314 6766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:45.628198 6766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:45.630270 6766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:45.630364 6766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:45.630498 6766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:45.630775 6766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:45.630808 6766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.630826 6766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:45.630838 6766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.636895 6766 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:42173
I20260808 14:40:45.636999 6962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:42173 every 8 connection(s)
I20260808 14:40:45.637272 6766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:45.639088 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 6766
I20260808 14:40:45.639232 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:45.639430 30371 external_mini_cluster.cc:1428] Setting key 6b4f4d1591484c64060f5026aec86fe9
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:45.647185 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.637923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:46723 (local address 127.29.168.254:44939)
0808 14:40:45.637963 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:45.637965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:45.638202 (+ 237us) server_negotiation.cc:407] Connection header received
0808 14:40:45.638588 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:45.638588 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:45.638597 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:45.638645 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:45.639594 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.640326 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.641220 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.641572 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.641644 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.644109 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:45.644111 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:45.644111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:45.644119 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:45.645633 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.646109 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.646111 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.646111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.646185 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.646455 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.646456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.646456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.646625 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:45.646711 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:45.646996 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 14:40:45.647087 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:40:45.647367 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.637898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:46723)
0808 14:40:45.638051 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:45.638107 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:45.638516 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:45.638689 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:45.638692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:45.639307 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:45.639486 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:45.639508 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.640419 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.640419 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:45.641112 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:45.641113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.641682 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.641683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:45.641868 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.642336 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:45.642346 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:45.643984 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:45.645767 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:45.645775 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:45.645777 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:45.646011 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:45.646268 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:45.646269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:45.646270 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:45.646383 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:45.646703 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:45.646711 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:45.646855 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 14:40:45.646971 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:40:45.647136 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260808 14:40:45.647959 6963 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44939
I20260808 14:40:45.648069 6963 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:45.648244 6963 heartbeater.cc:511] Master 127.29.168.254:44939 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.29.168.194@KRBTEST.COM; defaulting to no policy
I20260808 14:40:45.648792 6669 ts_manager.cc:194] Registered new tserver with Master: 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173)
I20260808 14:40:45.649317 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:46723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab.
Entry for principal oryx/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab.
I20260808 14:40:45.664525 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44939
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:45.741554 6972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:45.741721 6972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:45.741742 6972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:45.742836 6972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:45.742894 6972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:45.742919 6972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:45.744393 6972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:45.744645 6972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:45.744850 6972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:45.749466 6979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.749476 6983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.749480 6980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:45.749656 6972 server_base.cc:1034] running on GCE node
I20260808 14:40:45.749874 6972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:45.750093 6972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:45.751226 6972 hybrid_clock.cc:648] HybridClock initialized: now 1786200045751204 us; error 36 us; skew 500 ppm
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:45.753759 6972 init.cc:377] Logged in from keytab as oryx/127.29.168.194@KRBTEST.COM (short username oryx)
I20260808 14:40:45.754213 6972 webserver.cc:460] Webserver started at http://127.29.168.194:38107/ using document root <none> and password file <none>
I20260808 14:40:45.754426 6972 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:45.754470 6972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:45.754622 6972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:45.755554 6972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "6cae014b9a124685b31d33c70e94e170"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "88d004621ba674832858926ab492512a"
server_key_iv: "45fadf3d59ba177294c17dd9a1e26529"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.755951 6972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "6cae014b9a124685b31d33c70e94e170"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "88d004621ba674832858926ab492512a"
server_key_iv: "45fadf3d59ba177294c17dd9a1e26529"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.757179 6972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:45.757871 6994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.758047 6972 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:45.758158 6972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "6cae014b9a124685b31d33c70e94e170"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "88d004621ba674832858926ab492512a"
server_key_iv: "45fadf3d59ba177294c17dd9a1e26529"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.758226 6972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:45.776046 6972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:45.778107 6972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:45.778203 6972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:45.778393 6972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:45.778668 6972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:45.778700 6972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.778719 6972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:45.778766 6972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.784278 6972 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:43695
I20260808 14:40:45.784346 7174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:43695 every 8 connection(s)
I20260808 14:40:45.784634 6972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:45.789230 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 6972
I20260808 14:40:45.789368 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:45.789566 30371 external_mini_cluster.cc:1428] Setting key a2fa2e48318c5ea90272b8409eb87b00
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:45.793778 7177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.785292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:43497)
0808 14:40:45.785430 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:45.785472 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:45.785931 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:45.786163 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:45.786167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:45.786734 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:45.786907 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:45.786911 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.787605 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.787606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:45.788357 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:45.788359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.788755 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.788755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:45.788883 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.789261 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:45.789270 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:45.790859 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:45.792481 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:45.792488 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:45.792490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:45.792776 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:45.792956 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:45.792957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:45.792957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:45.793096 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:45.793289 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:45.793294 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:45.793410 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 14:40:45.793523 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:40:45.793630 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":60,"threads_started":1}
I20260808 14:40:45.793807 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.785343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:43497 (local address 127.29.168.254:44939)
0808 14:40:45.785392 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:45.785395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:45.785559 (+ 164us) server_negotiation.cc:407] Connection header received
0808 14:40:45.786036 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:45.786037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:45.786051 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:45.786103 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:45.787014 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.787507 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.788457 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.788649 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.788747 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.790942 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:45.790943 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:45.790944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:45.790951 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:45.792405 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.792852 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.792852 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.792853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.792897 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.793156 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.793157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.793157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.793239 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:45.793282 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:45.793576 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 14:40:45.793668 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:45.794278 7175 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44939
I20260808 14:40:45.794379 7175 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:45.794543 7175 heartbeater.cc:511] Master 127.29.168.254:44939 requested a full tablet report, sending...
I20260808 14:40:45.794921 6669 ts_manager.cc:194] Registered new tserver with Master: 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695)
I20260808 14:40:45.795437 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:43497
WARNING: no policy specified for oryx/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab.
Entry for principal oryx/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab.
I20260808 14:40:45.815914 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44939
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:45.895987 7180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:45.896139 7180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:45.896158 7180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:45.897143 7180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:45.897172 7180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:45.897194 7180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:45.898419 7180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:45.898582 7180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:45.898726 7180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:45.903292 7188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.903363 7189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:45.903322 7191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:45.903493 7180 server_base.cc:1034] running on GCE node
I20260808 14:40:45.903750 7180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:45.904013 7180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:45.905151 7180 hybrid_clock.cc:648] HybridClock initialized: now 1786200045905142 us; error 28 us; skew 500 ppm
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:45.907691 7180 init.cc:377] Logged in from keytab as oryx/127.29.168.195@KRBTEST.COM (short username oryx)
I20260808 14:40:45.908079 7180 webserver.cc:460] Webserver started at http://127.29.168.195:46723/ using document root <none> and password file <none>
I20260808 14:40:45.908308 7180 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:45.908371 7180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:45.908505 7180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:45.909447 7180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "7fcfdc8956824afa9cb59d0fb697f6bf"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "67a8fd95e08b6ef37046038397c07ade"
server_key_iv: "9f5ee83c2296e32cf8e0e9213cb3235d"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.909780 7180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "7fcfdc8956824afa9cb59d0fb697f6bf"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "67a8fd95e08b6ef37046038397c07ade"
server_key_iv: "9f5ee83c2296e32cf8e0e9213cb3235d"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.911079 7180 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:45.911816 7205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.911981 7180 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:45.912081 7180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "7fcfdc8956824afa9cb59d0fb697f6bf"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "67a8fd95e08b6ef37046038397c07ade"
server_key_iv: "9f5ee83c2296e32cf8e0e9213cb3235d"
server_key_version: "encryptionkey@0"
I20260808 14:40:45.912154 7180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:45.928426 7180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:45.930505 7180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:45.930651 7180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:45.930855 7180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:45.931143 7180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:45.931195 7180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.931229 7180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:45.931264 7180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:45.937472 7180 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45089
I20260808 14:40:45.937511 7379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45089 every 8 connection(s)
I20260808 14:40:45.937850 7180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:45.940269 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 7180
I20260808 14:40:45.940353 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:45.940522 30371 external_mini_cluster.cc:1428] Setting key 4d82d7bfcaa144d95a6c29a9bdea50f4
Aug 08 14:40:45 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:45.946769 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.938511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:48997 (local address 127.29.168.254:44939)
0808 14:40:45.938551 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:45.938552 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:45.938726 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:40:45.939160 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:45.939161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:45.939182 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:45.939226 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:45.940111 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.940679 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.941878 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.942044 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.942094 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.944156 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:45.944158 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:45.944158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:45.944163 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:45.945506 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.945875 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.945876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.945876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.945925 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:45.946145 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:45.946146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:45.946146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:45.946281 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:45.946341 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:45.946644 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 14:40:45.946706 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:45.947009 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:45.938470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:48997)
0808 14:40:45.938617 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:45.938651 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:45.939071 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:45.939281 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:45.939284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:45.939839 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:45.940015 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:45.940019 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.940780 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.940781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:45.941812 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:45.941815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:45.942112 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:45.942113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:45.942203 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:45.942653 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:45.942661 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:45.944071 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:45.945582 (+ 1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:45.945588 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:45.945589 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:45.945810 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:45.945982 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:45.945983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:45.945983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:45.946073 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:45.946369 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:45.946375 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:45.946518 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:40:45.946616 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:40:45.946741 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":88,"threads_started":1}
I20260808 14:40:45.947510 7380 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44939
I20260808 14:40:45.947593 7380 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:45.947819 7380 heartbeater.cc:511] Master 127.29.168.254:44939 requested a full tablet report, sending...
I20260808 14:40:45.948240 6669 ts_manager.cc:194] Registered new tserver with Master: 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089)
I20260808 14:40:45.948568 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:48997
I20260808 14:40:45.952400 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.168.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.253.keytab.
Entry for principal oryx/127.29.168.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.253.keytab.
I20260808 14:40:45.977982 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:45601
--webserver_interface=127.29.168.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.253.keytab
--principal=oryx/127.29.168.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44939,127.29.168.253:45601
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:46.055920 7385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:46.056128 7385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:46.056161 7385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:46.057192 7385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:46.057255 7385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:46.057276 7385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:46.057292 7385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:46.057310 7385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:46.058662 7385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44939,127.29.168.253:45601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.253.keytab
--principal=oryx/127.29.168.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:45601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.168.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
W20260808 14:40:46.058795 7385 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.29.168.254:44939,127.29.168.253:45601'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 14:40:46.058928 7385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:46.059115 7385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:46.063786 7397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.063777 7393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.063923 7385 server_base.cc:1034] running on GCE node
W20260808 14:40:46.063777 7392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.064338 7385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.064641 7385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.065796 7385 hybrid_clock.cc:648] HybridClock initialized: now 1786200046065773 us; error 32 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.068356 7385 init.cc:377] Logged in from keytab as oryx/127.29.168.253@KRBTEST.COM (short username oryx)
I20260808 14:40:46.068807 7385 webserver.cc:460] Webserver started at http://127.29.168.253:35975/ using document root <none> and password file <none>
I20260808 14:40:46.069047 7385 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.069087 7385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.069237 7385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:46.070204 7385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/instance:
uuid: "40f1f05fdb21478387d8bfa30b6176f7"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "7786efd216c00544d24013e04ff2b675"
server_key_iv: "9299a545e498ec7107d73d3568ccb5d1"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.070526 7385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal/instance:
uuid: "40f1f05fdb21478387d8bfa30b6176f7"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "7786efd216c00544d24013e04ff2b675"
server_key_iv: "9299a545e498ec7107d73d3568ccb5d1"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.071672 7385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:40:46.072398 7407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.072597 7385 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:46.072680 7385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
uuid: "40f1f05fdb21478387d8bfa30b6176f7"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "7786efd216c00544d24013e04ff2b675"
server_key_iv: "9299a545e498ec7107d73d3568ccb5d1"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.072745 7385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.087242 7385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.089277 7385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:46.089380 7385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.093036 7385 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.253:45601
I20260808 14:40:46.093065 7484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.253:45601 every 8 connection(s)
I20260808 14:40:46.093356 7385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
I20260808 14:40:46.094635 7485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:46.096056 7485 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.253@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:46.102721 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 7385
I20260808 14:40:46.104553 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.096722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38828 (local address 127.29.168.254:44939)
0808 14:40:46.096779 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.096781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.096996 (+ 215us) server_negotiation.cc:407] Connection header received
0808 14:40:46.097463 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.097465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.097478 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.097536 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.098089 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.098545 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.099437 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.099619 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.099749 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.101670 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.101671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.101672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.101678 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.103056 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.103523 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.103524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.103524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.103607 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.103883 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.103884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.103884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.104101 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.104181 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.104430 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.104492 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:40:46.104756 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.096703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:38828)
0808 14:40:46.096884 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.096915 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.097364 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.097600 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.097603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.097835 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.097997 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.098001 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.098650 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.098651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.099348 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.099350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.099760 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.099761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.099874 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.100283 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.100290 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.101585 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.103130 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.103137 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.103140 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.103430 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.103695 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.103696 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.103696 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.103802 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.104174 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.104178 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.104277 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.104404 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.104551 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
I20260808 14:40:46.105392 7485 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.253@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
I20260808 14:40:46.112106 7491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.103201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.29.168.253:45601)
0808 14:40:46.103368 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.103372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.103407 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:40:46.103454 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.103457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.103470 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.103563 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.104337 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.105172 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.106094 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.106454 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.106553 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.109192 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.109200 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.109200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.109208 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.110842 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.111248 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.111251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.111251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.111327 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.111537 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.111538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.111538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.111720 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.111858 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.111900 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.111982 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
I20260808 14:40:46.112895 7489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.105596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55166)
0808 14:40:46.105641 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.105651 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.105692 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.105916 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.105917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.106011 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.106047 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.106048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.106838 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.106839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.107393 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.107396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.107956 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.107957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.108002 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.108418 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.108423 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.109751 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.112088 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.112088 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.112089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.112294 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.112472 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.112472 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.112473 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.112513 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.112709 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.112710 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.112739 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.112787 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.112848 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:40:46.112991 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.105665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.29.168.253:45601)
0808 14:40:46.105808 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.105810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.105817 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:46.105834 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.105835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.105843 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.105906 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.106156 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.106748 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.107478 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.107889 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.107956 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.109849 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.109850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.109850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.109856 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.112021 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.112363 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.112364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.112364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.112416 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.112549 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.112550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.112551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.112653 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.112708 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.112818 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.112889 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260808 14:40:46.114063 7485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Bootstrap starting.
I20260808 14:40:46.114727 7485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:46.114993 7485 log.cc:824] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:46.115768 7485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: No bootstrap required, opened a new log
I20260808 14:40:46.116973 7485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } }
I20260808 14:40:46.117097 7485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:46.117141 7485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f1f05fdb21478387d8bfa30b6176f7, State: Initialized, Role: FOLLOWER
I20260808 14:40:46.117282 7485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } }
I20260808 14:40:46.117585 7485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:46.117550 7499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } } }
I20260808 14:40:46.117673 7499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:40:46.119158 7521 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:46.119211 7521 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:46.121001 7385 master_runner.cc:428] Detected that this master 40f1f05fdb21478387d8bfa30b6176f7 is joining an existing cluster
I20260808 14:40:46.121088 7385 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.168.253:45601
I20260808 14:40:46.128681 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.122092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38842 (local address 127.29.168.254:44939)
0808 14:40:46.122130 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.122132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.122436 (+ 304us) server_negotiation.cc:407] Connection header received
0808 14:40:46.122512 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.122513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.122525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.122580 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.122968 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.123743 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.124572 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.124793 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.124872 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.126006 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.126008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.126008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.126014 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.127558 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.127960 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.127961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.127962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.128008 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.128215 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.128216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.128216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.128318 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.128385 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.128533 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.128600 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:46.128696 7534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.122045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:38842)
0808 14:40:46.122387 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.122395 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.122457 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.122601 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.122601 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.122809 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.122877 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.122879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.123831 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.123832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.124491 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.124493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.125067 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.125068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.125114 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.125465 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.125475 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.125885 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.127633 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.127634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.127635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.127909 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.128074 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.128075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.128075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.128155 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.128388 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.128389 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.128431 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.128508 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.128601 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":5,"thread_start_us":126,"threads_started":1}
I20260808 14:40:46.128775 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.122246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.29.168.253:45601)
0808 14:40:46.122276 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.122277 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.122286 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:46.122357 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.122357 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.122365 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.122436 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.122809 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.123249 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.124207 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.124531 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.124602 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.125500 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.125501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.125501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.125506 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.127344 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.127794 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.127795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.127795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.127847 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.128064 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.128065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.128065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.128178 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.128218 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.128388 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.128462 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":15}
I20260808 14:40:46.129055 7536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.122042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55172)
0808 14:40:46.122225 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.122235 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.122298 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.122440 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.122441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.122654 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.122740 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.122741 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.123333 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.123334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.124119 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.124121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.124658 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.124658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.124732 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.125070 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.125074 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.125416 (+ 342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.127434 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.127435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.127436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.127723 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.127918 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.127919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.127919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.127990 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.128257 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.128257 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.128299 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.128872 (+ 573us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.128953 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"spinlock_wait_cycles":7040,"thread_start_us":131,"threads_started":1}
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.254@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
I20260808 14:40:46.137789 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.131103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55180)
0808 14:40:46.131231 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.131264 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.131319 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.131438 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.131440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.131632 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.131735 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.131737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.132532 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.132533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.133065 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.133067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.133522 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.133523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.133575 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.133987 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.133991 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.135206 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.136843 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.136849 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.136851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.137057 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.137262 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.137263 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.137263 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.137311 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.137550 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.137555 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.137589 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.137644 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.137721 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260808 14:40:46.137830 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.131149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55180 (local address 127.29.168.253:45601)
0808 14:40:46.131181 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.131182 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.131326 (+ 144us) server_negotiation.cc:407] Connection header received
0808 14:40:46.131371 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.131372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.131380 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.131436 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.131813 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.132461 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.133142 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.133428 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.133515 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.135317 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.135318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.135318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.135324 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.136763 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.137142 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.137143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.137144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.137199 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.137384 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.137385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.137385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.137493 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.137553 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.137683 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.137749 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:46.138353 6669 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.168.253:45601: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7"
member_type: NON_VOTER
last_known_addr {
host: "127.29.168.253"
port: 45601
}
attrs {
promote: true
}
}
dest_uuid: "bf85c793f92346ac8d36e21f8de1ea17"
cas_config_opid_index: -1
I20260808 14:40:46.138661 6669 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } }
I20260808 14:40:46.139180 7539 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 40f1f05fdb21478387d8bfa30b6176f7 (127.29.168.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } }
I20260808 14:40:46.139429 7446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:46.140259 7539 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.168.253:45601
I20260808 14:40:46.140333 7446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Refusing update from remote peer bf85c793f92346ac8d36e21f8de1ea17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 14:40:46.140475 7538 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } }
I20260808 14:40:46.140559 7538 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.140676 7538 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:46.140758 7385 master.cc:537] Master@127.29.168.253:45601 shutting down...
W20260808 14:40:46.141396 6644 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 14:40:46.141821 6644 consensus_peers.cc:487] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 -> Peer 40f1f05fdb21478387d8bfa30b6176f7 (127.29.168.253:45601): Couldn't send request to peer 40f1f05fdb21478387d8bfa30b6176f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:40:46.143371 7385 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:46.143453 7385 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:46.143519 7385 tablet_replica.cc:330] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: stopping tablet replica
I20260808 14:40:46.156302 7385 master.cc:552] Master@127.29.168.253:45601 shutdown complete.
I20260808 14:40:46.156368 7385 master_runner.cc:305] Clearing existing system tablet
I20260808 14:40:46.156488 7385 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.156548 7385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.157171 7385 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:46.157621 7543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.157792 7385 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.157856 7385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.157907 7385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
uuid: "40f1f05fdb21478387d8bfa30b6176f7"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "7786efd216c00544d24013e04ff2b675"
server_key_iv: "9299a545e498ec7107d73d3568ccb5d1"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.158527 7385 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:46.160141 7385 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:40:46.160195 7385 log.cc:1196] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 14:40:46.160389 7385 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Deleting consensus metadata
I20260808 14:40:46.160533 7385 master_runner.cc:315] Copying system tablet from 127.29.168.254:44939
I20260808 14:40:46.161134 7385 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: tablet copy: Beginning tablet copy session from remote peer at address 127.29.168.254:44939
I20260808 14:40:46.166913 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.161501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38852 (local address 127.29.168.254:44939)
0808 14:40:46.161543 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.161545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.161641 (+ 96us) server_negotiation.cc:407] Connection header received
0808 14:40:46.161693 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.161694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.161704 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.161754 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.162051 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.162523 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.163340 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.163561 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.163636 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.164552 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.164554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.164554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.164561 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.165791 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.166130 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.166131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.166132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.166183 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.166383 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.166384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.166385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.166503 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.166593 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.166752 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.166824 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:46.166944 7553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.161440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:38852)
0808 14:40:46.161557 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.161567 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.161638 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.161759 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.161759 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.161918 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.161986 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.161988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.162588 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.162589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.163256 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.163259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.163636 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.163681 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.163749 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.164198 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.164202 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.164465 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.165892 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.165893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.165894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.166059 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.166256 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.166257 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.166257 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.166313 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.166596 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.166597 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.166641 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.166727 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.166835 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260808 14:40:46.167276 6696 tablet_copy_service.cc:140] P bf85c793f92346ac8d36e21f8de1ea17: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 40f1f05fdb21478387d8bfa30b6176f7 ({username='oryx', principal='oryx/127.29.168.253@KRBTEST.COM'} at 127.0.0.1:38852)
I20260808 14:40:46.167403 6696 tablet_copy_service.cc:161] P bf85c793f92346ac8d36e21f8de1ea17: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 40f1f05fdb21478387d8bfa30b6176f7 at {username='oryx', principal='oryx/127.29.168.253@KRBTEST.COM'} at 127.0.0.1:38852: session id = 40f1f05fdb21478387d8bfa30b6176f7-00000000000000000000000000000000
I20260808 14:40:46.168219 6696 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:40:46.168800 7385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:40:46.169607 7385 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: tablet copy: Starting download of 0 data blocks...
I20260808 14:40:46.169754 7385 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: tablet copy: Starting download of 1 WAL segments...
I20260808 14:40:46.170740 7385 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:40:46.171397 6696 tablet_copy_service.cc:342] P bf85c793f92346ac8d36e21f8de1ea17: Request end of tablet copy session 40f1f05fdb21478387d8bfa30b6176f7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.168.253@KRBTEST.COM'} at 127.0.0.1:38852
I20260808 14:40:46.171450 6696 tablet_copy_service.cc:433] P bf85c793f92346ac8d36e21f8de1ea17: ending tablet copy session 40f1f05fdb21478387d8bfa30b6176f7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 40f1f05fdb21478387d8bfa30b6176f7
I20260808 14:40:46.173534 7385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:46.174568 7564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.174592 7555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.174621 7557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.175755 7385 server_base.cc:1034] running on GCE node
I20260808 14:40:46.175905 7385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.176036 7385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.177147 7385 hybrid_clock.cc:648] HybridClock initialized: now 1786200046177141 us; error 22 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.178462 7385 init.cc:377] Logged in from keytab as oryx/127.29.168.253@KRBTEST.COM (short username oryx)
I20260808 14:40:46.178735 7385 webserver.cc:460] Webserver started at http://127.29.168.253:41267/ using document root <none> and password file <none>
I20260808 14:40:46.178850 7385 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.178906 7385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.179497 7385 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.180073 7574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.180213 7385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.180280 7385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
uuid: "40f1f05fdb21478387d8bfa30b6176f7"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "7786efd216c00544d24013e04ff2b675"
server_key_iv: "9299a545e498ec7107d73d3568ccb5d1"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.180328 7385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.201442 7385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.203027 7385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.206205 7385 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.253:45601
I20260808 14:40:46.206463 7653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.253:45601 every 8 connection(s)
I20260808 14:40:46.206627 7385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
I20260808 14:40:46.207329 7654 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:40:46.207803 7654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Bootstrap starting.
I20260808 14:40:46.210013 7654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:40:46.210239 7654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Bootstrap complete.
I20260808 14:40:46.210427 7654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } }
I20260808 14:40:46.210502 7654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 40f1f05fdb21478387d8bfa30b6176f7, State: Initialized, Role: LEARNER
I20260808 14:40:46.210541 7654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } }
I20260808 14:40:46.210704 7654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:46.210685 7658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } }
I20260808 14:40:46.210748 7658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:40:46.212013 7673 catalog_manager.cc:1259] Loaded cluster ID: 77744ce3de4346f297104d0087817ddd
I20260808 14:40:46.212081 7673 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: loading cluster ID for follower catalog manager: success
I20260808 14:40:46.212913 7673 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: acquiring CA information for follower catalog manager: success
I20260808 14:40:46.213200 7673 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:40:46.220273 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.213413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55202 (local address 127.29.168.253:45601)
0808 14:40:46.213529 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.213531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.213540 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:46.213568 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.213569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.213577 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.213639 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.214302 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.215038 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.216048 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.216230 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.216294 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.217637 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.217638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.217639 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.217645 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.219107 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.219487 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.219488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.219489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.219549 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.219802 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.219803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.219803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.219894 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.219994 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.220093 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.220167 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
WARNING: no policy specified for oryx/127.29.168.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.252.keytab.
Entry for principal oryx/127.29.168.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.252.keytab.
I20260808 14:40:46.248136 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:37687
--webserver_interface=127.29.168.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.252.keytab
--principal=oryx/127.29.168.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:46.338383 7680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:46.338560 7680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:46.338580 7680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:46.339557 7680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:46.339586 7680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:46.339597 7680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:46.339608 7680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:46.339618 7680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:46.340998 7680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.252.keytab
--principal=oryx/127.29.168.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:37687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.168.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:46.341173 7680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:46.341333 7680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:46.345954 7696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.345992 7694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.346179 7680 server_base.cc:1034] running on GCE node
W20260808 14:40:46.346007 7693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.346405 7680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.346719 7680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.347877 7680 hybrid_clock.cc:648] HybridClock initialized: now 1786200046347863 us; error 27 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.350235 7680 init.cc:377] Logged in from keytab as oryx/127.29.168.252@KRBTEST.COM (short username oryx)
I20260808 14:40:46.350684 7680 webserver.cc:460] Webserver started at http://127.29.168.252:33153/ using document root <none> and password file <none>
I20260808 14:40:46.350917 7680 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.350984 7680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.351135 7680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:46.352167 7680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/instance:
uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "07a249b664df4827ab2d8285ab4a36af"
server_key_iv: "1b6873721034a91bc8f4196748acb4fd"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.352531 7680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal/instance:
uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "07a249b664df4827ab2d8285ab4a36af"
server_key_iv: "1b6873721034a91bc8f4196748acb4fd"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.353827 7680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:46.354552 7706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.354730 7680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:46.354825 7680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "07a249b664df4827ab2d8285ab4a36af"
server_key_iv: "1b6873721034a91bc8f4196748acb4fd"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.354900 7680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.373046 7680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.374778 7680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:46.374943 7680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.378958 7680 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.252:37687
I20260808 14:40:46.379030 7792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.252:37687 every 8 connection(s)
I20260808 14:40:46.379350 7680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
I20260808 14:40:46.380412 7794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:46.381861 7794 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:40:46.382879 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 7680
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.252@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.168.252@KRBTEST.COM
I20260808 14:40:46.391371 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.382590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38864 (local address 127.29.168.254:44939)
0808 14:40:46.382636 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.382638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.382706 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:40:46.383354 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.383356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.383369 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.383443 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.384126 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.384635 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.385769 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.386024 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.386075 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.388441 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.388442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.388442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.388448 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.390049 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.390485 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.390486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.390486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.390545 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.390778 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.390779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.390779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.390896 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.390962 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.391210 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.391280 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:46.391523 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.382450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:38864)
0808 14:40:46.382605 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.382641 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.383229 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.383588 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.383592 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.383887 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.384033 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.384037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.384757 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.384759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.385671 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.385674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.386117 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.386118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.386224 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.386761 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.386770 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.388345 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.390145 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.390151 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.390153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.390408 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.390608 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.390609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.390609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.390711 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.390966 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.390984 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.391097 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.391187 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.391309 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
I20260808 14:40:46.391775 7800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.383394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58052 (local address 127.29.168.252:37687)
0808 14:40:46.383607 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.383611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.383625 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:40:46.383678 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.383681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.383704 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.383802 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.384395 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.385146 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.385874 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.386205 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.386273 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.389028 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.389035 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.389035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.389042 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.390636 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.391004 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.391006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.391007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.391059 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.391238 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.391239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.391239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.391367 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.391523 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.391590 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.391676 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":123,"threads_started":1}
I20260808 14:40:46.392205 7794 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.252@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
I20260808 14:40:46.397492 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.392408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55212)
0808 14:40:46.392452 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.392461 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.392492 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.392605 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.392605 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.392698 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.392721 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.392722 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.393243 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.393243 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.393744 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.393746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.394078 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.394078 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.394118 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.394412 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.394416 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.395460 (+ 1044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.396820 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.396821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.396821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.396969 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.397120 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.397121 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.397121 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.397158 (+ 37us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.397311 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.397311 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.397340 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.397384 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.397441 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:40:46.397516 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.392467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55212 (local address 127.29.168.253:45601)
0808 14:40:46.392503 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.392505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.392511 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:46.392557 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.392557 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.392567 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.392604 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.392773 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.393183 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.393822 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.394014 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.394065 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.395562 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.395564 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.395564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.395571 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.396735 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.397030 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.397031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.397031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.397082 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.397189 (+ 107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.397190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.397190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.397270 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.397313 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.397398 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.397458 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:46.397946 7794 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.252@KRBTEST.COM for oryx/127.29.168.252@KRBTEST.COM
I20260808 14:40:46.403131 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.398169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58056)
0808 14:40:46.398219 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.398229 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.398268 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.398376 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.398376 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.398471 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.398493 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.398493 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.398970 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.398970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.399359 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.399360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.399683 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.399684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.399726 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.400018 (+ 292us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.400022 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.401006 (+ 984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.402461 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.402462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.402462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.402598 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.402733 (+ 135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.402733 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.402734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.402777 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.402929 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.402930 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.402959 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.403006 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.403083 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:40:46.403242 7800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.398229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58056 (local address 127.29.168.252:37687)
0808 14:40:46.398268 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.398269 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.398276 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:46.398316 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.398317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.398324 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.398374 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.398528 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.398895 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.399422 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.399588 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.399632 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.401071 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.401072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.401072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.401078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.402397 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.402647 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.402648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.402648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.402685 (+ 37us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.402812 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.402812 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.402812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.402884 (+ 72us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.402925 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.403019 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.403120 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":18}
I20260808 14:40:46.404398 7794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Bootstrap starting.
I20260808 14:40:46.405167 7794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:46.405439 7794 log.cc:824] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:46.406152 7794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: No bootstrap required, opened a new log
I20260808 14:40:46.407491 7794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } }
I20260808 14:40:46.407600 7794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:46.407647 7794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04aae7c4f7c04079bed5a3a48fd57ed8, State: Initialized, Role: FOLLOWER
I20260808 14:40:46.407845 7794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } }
I20260808 14:40:46.408119 7794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:46.408089 7803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } } }
I20260808 14:40:46.408196 7803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:40:46.409716 7817 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:46.409796 7817 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:46.411926 7680 master_runner.cc:428] Detected that this master 04aae7c4f7c04079bed5a3a48fd57ed8 is joining an existing cluster
I20260808 14:40:46.411971 7680 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.168.252:37687
I20260808 14:40:46.419353 7835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.412909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55218)
0808 14:40:46.413173 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.413183 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.413219 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.413453 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.413454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.413661 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.413720 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.413721 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.414598 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.414598 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.415430 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.415432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.415957 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415957 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.416019 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.416454 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.416459 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.416767 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.418464 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.418465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.418465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.418623 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.418821 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.418822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.418822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.418882 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.419133 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.419133 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.419175 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.419222 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.419293 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":60,"threads_started":1}
I20260808 14:40:46.419402 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.413238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55218 (local address 127.29.168.253:45601)
0808 14:40:46.413333 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.413335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.413342 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:46.413361 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.413362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.413370 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.413423 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.413807 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.414512 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415518 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.415824 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415865 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.416868 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.416869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.416870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.416877 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.418377 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.418692 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.418693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.418694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.418753 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.418942 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.418943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.418944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.419078 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.419143 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.419244 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.419311 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:40:46.439553 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.412885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38872 (local address 127.29.168.254:44939)
0808 14:40:46.412925 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.412927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.413027 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:40:46.413118 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.413119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.413128 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.413178 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.413616 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.414387 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415532 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.415858 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415896 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.436942 (+ 21046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.436944 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.436944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.436951 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.438395 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.438812 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.438813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.438813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.438863 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.439059 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.439059 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.439060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.439167 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.439237 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.439391 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.439468 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:46.439559 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.412862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:38872)
0808 14:40:46.412977 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.412986 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.413048 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.413221 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.413221 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.413402 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.413502 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.413504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.414502 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.414502 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.415414 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.415417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.415982 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.416036 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.436317 (+ 20281us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.436320 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.436845 (+ 525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.438484 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.438485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.438485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.438734 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.438936 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.438936 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.438937 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.438993 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.439229 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.439230 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.439270 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.439338 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.439441 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":69,"threads_started":1}
I20260808 14:40:46.439977 7832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.413058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58060)
0808 14:40:46.413500 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.413509 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.413587 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.413725 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.413726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.413968 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.414026 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.414028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.414907 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.414907 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.415780 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.415782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.416246 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.416247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.416302 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.436234 (+ 19932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.436239 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.436804 (+ 565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.438813 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.438814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.438814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.438989 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.439386 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.439386 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.439386 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.439434 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.439688 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.439689 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.439735 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.439796 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.439877 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":82,"threads_started":1}
I20260808 14:40:46.440177 7800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.413269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58060 (local address 127.29.168.252:37687)
0808 14:40:46.413312 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.413313 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.413569 (+ 256us) server_negotiation.cc:407] Connection header received
0808 14:40:46.413647 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.413648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.413655 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.413679 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.414106 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.414795 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.415871 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.416145 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.416183 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.436880 (+ 20697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.436882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.436882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.436889 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.438735 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.439274 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.439275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.439275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.439323 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.439491 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.439491 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.439492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.439589 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.439627 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.440050 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.440116 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:40:46.442920 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 6766
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200045, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.254@KRBTEST.COM for oryx/127.29.168.252@KRBTEST.COM
I20260808 14:40:46.465493 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.441714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58068)
0808 14:40:46.441771 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.441781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.441817 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.442044 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.442044 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.442147 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.442178 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.442179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.442943 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.442944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.443927 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.443931 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.460372 (+ 16441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.460374 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.460444 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.460921 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.460927 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.462560 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.464385 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.464386 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.464386 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.464599 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.464812 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.464813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.464813 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.464870 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.465174 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.465175 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.465218 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.465283 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.465395 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:40:46.465720 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:42173
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:44939
--webserver_port=34375
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:46.465830 7800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.441885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.29.168.252:37687)
0808 14:40:46.441938 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.441939 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.441947 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:46.441974 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.441974 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.441982 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.442033 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.442236 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.442864 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.459935 (+ 17071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.460219 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.460308 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.462671 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.462672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.462672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.462679 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.464278 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.464676 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.464677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.464678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.464744 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.464960 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.464960 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.464961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.465082 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.465145 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.465676 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.465748 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:46.467814 6669 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.168.252:37687: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
member_type: NON_VOTER
last_known_addr {
host: "127.29.168.252"
port: 37687
}
attrs {
promote: true
}
}
dest_uuid: "bf85c793f92346ac8d36e21f8de1ea17"
cas_config_opid_index: 5
I20260808 14:40:46.468061 6669 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } }
I20260808 14:40:46.468600 7539 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.469537 7539 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.168.252:37687
I20260808 14:40:46.469599 7539 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.469662 7539 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.470474 7750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:46.471582 7750 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Refusing update from remote peer bf85c793f92346ac8d36e21f8de1ea17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:40:46.471782 7680 master.cc:537] Master@127.29.168.252:37687 shutting down...
I20260808 14:40:46.472499 7538 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:40:46.473332 6644 consensus_peers.cc:487] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 -> Peer 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252:37687): Couldn't send request to peer 04aae7c4f7c04079bed5a3a48fd57ed8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:40:46.475268 7680 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:46.475361 7680 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:46.475419 7680 tablet_replica.cc:330] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: stopping tablet replica
I20260808 14:40:46.476573 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.469849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55228)
0808 14:40:46.470128 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.470138 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.470180 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.470394 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.470395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.470397 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.470437 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.470439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.471306 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.471308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.475491 (+ 4183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.475494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.476354 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.476355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.476415 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.476434 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.476481 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.476513 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263}
I20260808 14:40:46.476851 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.470017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55228 (local address 127.29.168.253:45601)
0808 14:40:46.470062 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.470064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.470231 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:40:46.470258 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.470259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.470280 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.470344 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.470501 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.471168 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.475579 (+ 4411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.476173 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.476240 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.476311 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.476756 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.476793 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:40:46.477542 7619 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 LEARNER]: Refusing update from remote peer bf85c793f92346ac8d36e21f8de1ea17: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:40:46.478011 7837 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 14:40:46.478619 7619 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.479724 7658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf85c793f92346ac8d36e21f8de1ea17. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.479799 7658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:40:46.479842 7840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: NON_VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: true } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.479990 7840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:40:46.484210 7837 raft_consensus.cc:1050] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: attempting to promote NON_VOTER 40f1f05fdb21478387d8bfa30b6176f7 to VOTER
I20260808 14:40:46.484403 7837 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } }
I20260808 14:40:46.484869 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.484756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58084)
0808 14:40:46.484799 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.484843 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:40:46.484944 7619 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 LEARNER]: Refusing update from remote peer bf85c793f92346ac8d36e21f8de1ea17: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:40:46.485229 7539 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 14:40:46.485275 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.485189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58086)
0808 14:40:46.485232 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.485256 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:40:46.485432 6644 consensus_peers.cc:487] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 -> Peer 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252:37687): Couldn't send request to peer 04aae7c4f7c04079bed5a3a48fd57ed8. Status: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:40:46.485844 7539 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 40f1f05fdb21478387d8bfa30b6176f7 (127.29.168.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.486720 7539 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.486797 7539 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.486853 7539 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.486900 7539 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.487124 7619 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 40f1f05fdb21478387d8bfa30b6176f7 (127.29.168.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.488104 7840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.488191 7840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:46.489480 7680 master.cc:552] Master@127.29.168.252:37687 shutdown complete.
I20260808 14:40:46.489521 7680 master_runner.cc:305] Clearing existing system tablet
I20260808 14:40:46.489638 7680 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.489682 7680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.490363 7680 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:46.490886 7845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.491062 7680 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.491118 7680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.491139 7680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "07a249b664df4827ab2d8285ab4a36af"
server_key_iv: "1b6873721034a91bc8f4196748acb4fd"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.491796 7680 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:46.493098 7680 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:40:46.493161 7680 log.cc:1196] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 14:40:46.493332 7680 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Deleting consensus metadata
I20260808 14:40:46.493460 7680 master_runner.cc:315] Copying system tablet from 127.29.168.254:44939
I20260808 14:40:46.494102 7680 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: tablet copy: Beginning tablet copy session from remote peer at address 127.29.168.254:44939
I20260808 14:40:46.501055 7852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.494406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:38876)
0808 14:40:46.494520 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.494530 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.494596 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.494780 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.494781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.494967 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.495016 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.495018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.495923 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.495925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.496635 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.496654 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.497098 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.497099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.497173 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.497637 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.497642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.498072 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.499914 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.499915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.499915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.500129 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.500334 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.500335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.500335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.500400 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.500730 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.500731 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.500787 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.500855 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.500950 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":72,"threads_started":1}
I20260808 14:40:46.501081 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.494411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38876 (local address 127.29.168.254:44939)
0808 14:40:46.494455 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.494457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.494600 (+ 143us) server_negotiation.cc:407] Connection header received
0808 14:40:46.494659 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.494660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.494673 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.494747 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.495108 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.495843 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.496743 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.497011 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.497088 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.498201 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.498202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.498202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.498209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.499831 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.500207 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.500208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.500208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.500266 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.500492 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.500494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.500494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.500637 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.500682 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.500911 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.500984 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:40:46.501667 6696 tablet_copy_service.cc:140] P bf85c793f92346ac8d36e21f8de1ea17: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 04aae7c4f7c04079bed5a3a48fd57ed8 ({username='oryx', principal='oryx/127.29.168.252@KRBTEST.COM'} at 127.0.0.1:38876)
I20260808 14:40:46.501721 6696 tablet_copy_service.cc:161] P bf85c793f92346ac8d36e21f8de1ea17: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 04aae7c4f7c04079bed5a3a48fd57ed8 at {username='oryx', principal='oryx/127.29.168.252@KRBTEST.COM'} at 127.0.0.1:38876: session id = 04aae7c4f7c04079bed5a3a48fd57ed8-00000000000000000000000000000000
I20260808 14:40:46.502310 6696 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:40:46.502774 7680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:40:46.503994 7680 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: tablet copy: Starting download of 0 data blocks...
I20260808 14:40:46.504146 7680 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: tablet copy: Starting download of 1 WAL segments...
I20260808 14:40:46.504891 7680 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:40:46.505712 6696 tablet_copy_service.cc:342] P bf85c793f92346ac8d36e21f8de1ea17: Request end of tablet copy session 04aae7c4f7c04079bed5a3a48fd57ed8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.168.252@KRBTEST.COM'} at 127.0.0.1:38876
I20260808 14:40:46.505767 6696 tablet_copy_service.cc:433] P bf85c793f92346ac8d36e21f8de1ea17: ending tablet copy session 04aae7c4f7c04079bed5a3a48fd57ed8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 04aae7c4f7c04079bed5a3a48fd57ed8
I20260808 14:40:46.508625 7680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:46.509837 7854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.509938 7858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.511878 7853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.511900 7680 server_base.cc:1034] running on GCE node
I20260808 14:40:46.512111 7680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.512238 7680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.513350 7680 hybrid_clock.cc:648] HybridClock initialized: now 1786200046513334 us; error 31 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.514816 7680 init.cc:377] Logged in from keytab as oryx/127.29.168.252@KRBTEST.COM (short username oryx)
I20260808 14:40:46.515064 7680 webserver.cc:460] Webserver started at http://127.29.168.252:37195/ using document root <none> and password file <none>
I20260808 14:40:46.515172 7680 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.515204 7680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.515903 7680 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:46.516448 7869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.516633 7680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:46.516683 7680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
format_stamp: "Formatted at 2026-08-08 14:40:46 on dist-test-slave-mjjr"
server_key: "07a249b664df4827ab2d8285ab4a36af"
server_key_iv: "1b6873721034a91bc8f4196748acb4fd"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.516731 7680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.533340 7680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.535126 7680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.538210 7680 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.252:37687
I20260808 14:40:46.538448 7950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.252:37687 every 8 connection(s)
I20260808 14:40:46.538508 7680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
I20260808 14:40:46.539371 7951 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:40:46.539911 7951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Bootstrap starting.
I20260808 14:40:46.542719 7951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:40:46.542929 7951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: Bootstrap complete.
I20260808 14:40:46.543107 7951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } }
I20260808 14:40:46.543190 7951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 04aae7c4f7c04079bed5a3a48fd57ed8, State: Initialized, Role: LEARNER
I20260808 14:40:46.543219 7951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } }
I20260808 14:40:46.543380 7951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:46.543403 7956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.543639 7956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:40:46.544878 7978 catalog_manager.cc:1259] Loaded cluster ID: 77744ce3de4346f297104d0087817ddd
I20260808 14:40:46.544970 7978 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: loading cluster ID for follower catalog manager: success
I20260808 14:40:46.546084 7978 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: acquiring CA information for follower catalog manager: success
I20260808 14:40:46.546386 7978 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 14:40:46.566888 7836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:46.567103 7836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:46.567150 7836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:46.568397 7836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:46.568467 7836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:46.568516 7836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:46.570020 7836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:42173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=34375
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:46.570258 7836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:46.570479 7836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:46.575181 7986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.575242 7836 server_base.cc:1034] running on GCE node
W20260808 14:40:46.575156 7990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.575205 7984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.575647 7836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.575896 7836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.577041 7836 hybrid_clock.cc:648] HybridClock initialized: now 1786200046577014 us; error 43 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.579345 7836 init.cc:377] Logged in from keytab as oryx/127.29.168.193@KRBTEST.COM (short username oryx)
I20260808 14:40:46.579813 7836 webserver.cc:460] Webserver started at http://127.29.168.193:34375/ using document root <none> and password file <none>
I20260808 14:40:46.580019 7836 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.580086 7836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.581338 7836 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:46.581887 7999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.582073 7836 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:46.582170 7836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "18527c8589eb47a5907b96c58659e3fe"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "4165673fbb62664e2c257a0c84e245c3"
server_key_iv: "b65ac816de229f2af7ae177b26b4b08a"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.582438 7836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.597712 7836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.599195 7836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:46.599323 7836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.599534 7836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:46.599845 7836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:46.599900 7836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.599932 7836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:46.599975 7836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.606631 7836 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:42173
I20260808 14:40:46.606689 8168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:42173 every 8 connection(s)
I20260808 14:40:46.607048 7836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:46.611677 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 7836
I20260808 14:40:46.611856 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 6972
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
I20260808 14:40:46.620525 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.608301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:33775 (local address 127.29.168.253:45601)
0808 14:40:46.608355 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.608357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.608449 (+ 92us) server_negotiation.cc:407] Connection header received
0808 14:40:46.609148 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.609149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.609162 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.609213 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.610068 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.610852 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.614416 (+ 3564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.614810 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.614860 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.617271 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.617272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.617272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.617279 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.619039 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.619444 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.619445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.619446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.619504 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.619815 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.619816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.619816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.619948 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.619983 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.620321 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.620420 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:46.620626 8180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.608149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.29.168.193:33775)
0808 14:40:46.608377 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.608385 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.609062 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.609286 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.609290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.609750 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.609924 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.609977 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.610926 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.610927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.614293 (+ 3366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.614296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.614976 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.614978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.615151 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.615696 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.615705 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.617166 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.619151 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.619159 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.619161 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.619369 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.619568 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.619569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.619569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.619744 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.620019 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.620023 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.620150 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.620230 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.620397 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":96,"thread_start_us":62,"threads_started":1}
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:46.627363 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.607900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:43227 (local address 127.29.168.254:44939)
0808 14:40:46.607977 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.607979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.608273 (+ 294us) server_negotiation.cc:407] Connection header received
0808 14:40:46.609170 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.609172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.609185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.609214 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.610091 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.610662 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.621862 (+ 11200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.622243 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.622328 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.624405 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.624406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.624407 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.624414 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.626135 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.626490 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.626491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.626491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.626581 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.626797 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.626798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.626798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.626968 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.627053 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.627177 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.627263 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:40:46.627375 8176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.607884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:43227)
0808 14:40:46.608118 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.608157 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.609052 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.609289 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.609291 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.609715 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.609923 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.609927 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.610780 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.610781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.621748 (+ 10967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.621751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.622323 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.622324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.622370 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.622752 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.622757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.624293 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.626215 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.626216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.626217 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.626403 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.626661 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.626662 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.626662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.626721 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.627044 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.627045 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.627083 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.627141 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.627234 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":22,"thread_start_us":89,"threads_started":1}
I20260808 14:40:46.628329 8171 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44939
I20260808 14:40:46.628412 8171 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.628573 8171 heartbeater.cc:511] Master 127.29.168.254:44939 requested a full tablet report, sending...
I20260808 14:40:46.628783 8172 heartbeater.cc:347] Connected to a master server at 127.29.168.253:45601
I20260808 14:40:46.628834 8172 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.628899 8172 heartbeater.cc:511] Master 127.29.168.253:45601 requested a full tablet report, sending...
I20260808 14:40:46.628928 6669 ts_manager.cc:194] Re-registered known tserver with Master: 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173)
I20260808 14:40:46.629254 7603 ts_manager.cc:194] Registered new tserver with Master: 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173)
I20260808 14:40:46.629599 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:43227
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.252@KRBTEST.COM
I20260808 14:40:46.633345 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:43695
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:44939
--webserver_port=38107
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:46.633778 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.607985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:39077 (local address 127.29.168.252:37687)
0808 14:40:46.608082 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.608084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.608333 (+ 249us) server_negotiation.cc:407] Connection header received
0808 14:40:46.609202 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.609204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.609216 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.609284 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.610033 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.611072 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.628779 (+ 17707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.629036 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.629096 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.630845 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.630846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.630846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.630854 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.632401 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.632768 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.632769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.632770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.632830 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.633044 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.633045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.633045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.633172 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.633257 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.633383 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.633649 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":47,"threads_started":1}
I20260808 14:40:46.633960 8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.607884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.29.168.193:39077)
0808 14:40:46.608149 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.608158 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.609051 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.609286 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.609290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.609743 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.609924 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.609931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.611142 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.611143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.628686 (+ 17543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.628689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.629148 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.629150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.629228 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.629679 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.629683 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.630747 (+ 1064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.632481 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.632482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.632482 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.632663 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.632914 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.632915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.632915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.632976 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.633258 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.633259 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.633291 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.633346 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.633414 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":21,"thread_start_us":90,"threads_started":1}
I20260808 14:40:46.635185 8170 heartbeater.cc:347] Connected to a master server at 127.29.168.252:37687
I20260808 14:40:46.635247 8170 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.635322 8170 heartbeater.cc:511] Master 127.29.168.252:37687 requested a full tablet report, sending...
I20260808 14:40:46.635684 7883 ts_manager.cc:194] Registered new tserver with Master: 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173)
W20260808 14:40:46.715305 8181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:46.715521 8181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:46.715559 8181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:46.716732 8181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:46.716790 8181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:46.716831 8181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:46.718370 8181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:43695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=38107
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:46.718617 8181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:46.718849 8181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:46.723627 8192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.723760 8181 server_base.cc:1034] running on GCE node
W20260808 14:40:46.723621 8188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.723606 8186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.724079 8181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.724331 8181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.725492 8181 hybrid_clock.cc:648] HybridClock initialized: now 1786200046725469 us; error 35 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.727888 8181 init.cc:377] Logged in from keytab as oryx/127.29.168.194@KRBTEST.COM (short username oryx)
I20260808 14:40:46.728351 8181 webserver.cc:460] Webserver started at http://127.29.168.194:38107/ using document root <none> and password file <none>
I20260808 14:40:46.728574 8181 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.728658 8181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.730000 8181 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:46.730589 8203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.730757 8181 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:46.730852 8181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "6cae014b9a124685b31d33c70e94e170"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "88d004621ba674832858926ab492512a"
server_key_iv: "45fadf3d59ba177294c17dd9a1e26529"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.731148 8181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.744719 8181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.746407 8181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:46.746583 8181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.746797 8181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:46.747088 8181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:46.747143 8181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.747181 8181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:46.747208 8181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.752948 8181 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:43695
I20260808 14:40:46.752982 8392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:43695 every 8 connection(s)
I20260808 14:40:46.753285 8181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:46.758858 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 8181
I20260808 14:40:46.759022 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 7180
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.252@KRBTEST.COM
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
I20260808 14:40:46.765261 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.754283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:48957 (local address 127.29.168.254:44939)
0808 14:40:46.754337 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.754340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.754350 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:46.755411 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.755412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.755427 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.755482 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.756222 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.756737 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.757715 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.757913 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.757984 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.760335 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.760337 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.760338 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.760345 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.763628 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.764233 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.764235 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.764235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.764309 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.764577 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.764578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.764578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.764700 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.764790 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.765092 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.765173 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:46.765674 8403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.753973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:48957)
0808 14:40:46.754139 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.754177 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.755290 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.755548 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.755552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.755926 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.756104 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.756107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.756849 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.756850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.757615 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.757617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.757991 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.757993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.758127 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.758673 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.758681 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.760242 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.763759 (+ 3517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.763766 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.763768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.764147 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.764385 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.764386 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.764386 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.764520 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.764795 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.764801 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.764952 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.765057 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.765207 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260808 14:40:46.766338 8399 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44939
I20260808 14:40:46.766422 8399 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.766629 8399 heartbeater.cc:511] Master 127.29.168.254:44939 requested a full tablet report, sending...
I20260808 14:40:46.766999 6669 ts_manager.cc:194] Re-registered known tserver with Master: 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695)
I20260808 14:40:46.767359 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:48957
I20260808 14:40:46.768623 8404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.754276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.29.168.194:46231)
0808 14:40:46.754397 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.754407 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.755311 (+ 904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.755557 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.755558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.755980 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.756105 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.756111 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.757089 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.757090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.757943 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.757945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.758404 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.758405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.758496 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.762648 (+ 4152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.762652 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.764112 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.767504 (+ 3392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.767504 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.767505 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.767775 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.767997 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.767997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.767998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.768053 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.768327 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.768328 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.768363 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.768423 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.768523 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":13,"thread_start_us":65,"threads_started":1}
I20260808 14:40:46.768618 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.754449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:46231 (local address 127.29.168.253:45601)
0808 14:40:46.754528 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.754530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.754539 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:46.755419 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.755421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.755434 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.755469 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.756241 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.756989 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.758048 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.758328 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.758394 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.764222 (+ 5828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.764224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.764224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.764233 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.766893 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.767858 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.767859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.767859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.767922 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.768121 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.768122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.768123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.768240 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.768293 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.768462 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.768536 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:40:46.770004 8400 heartbeater.cc:347] Connected to a master server at 127.29.168.253:45601
I20260808 14:40:46.770066 8400 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.770133 8400 heartbeater.cc:511] Master 127.29.168.253:45601 requested a full tablet report, sending...
I20260808 14:40:46.770401 7603 ts_manager.cc:194] Registered new tserver with Master: 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695)
I20260808 14:40:46.779138 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.753985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:32877 (local address 127.29.168.252:37687)
0808 14:40:46.754031 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.754034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.754251 (+ 217us) server_negotiation.cc:407] Connection header received
0808 14:40:46.755462 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.755463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.755479 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.755530 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.756241 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.756999 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.758039 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.758244 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.758276 (+ 32us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.776507 (+ 18231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.776509 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.776509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.776517 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.777977 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.778343 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.778344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.778344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.778403 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.778619 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.778620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.778620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.778728 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.778814 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.778952 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.779036 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:40:46.779161 8402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.753973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.29.168.194:32877)
0808 14:40:46.754138 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.754178 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.755314 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.755574 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.755574 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.755978 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.756105 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.756111 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.757089 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.757090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.757946 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.757947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.758373 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.758373 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.758456 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.758820 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.758824 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.762550 (+ 3726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.778067 (+ 15517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.778068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.778068 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.778271 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.778491 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.778492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.778492 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.778552 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.778804 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.778805 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.778845 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.778929 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.779035 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":41,"thread_start_us":110,"threads_started":1}
I20260808 14:40:46.779439 8397 heartbeater.cc:347] Connected to a master server at 127.29.168.252:37687
I20260808 14:40:46.779481 8397 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.779528 8397 heartbeater.cc:511] Master 127.29.168.252:37687 requested a full tablet report, sending...
I20260808 14:40:46.779807 7883 ts_manager.cc:194] Registered new tserver with Master: 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695)
I20260808 14:40:46.780870 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:45089
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:44939
--webserver_port=46723
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:46.861285 8406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:46.861479 8406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:46.861528 8406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:46.862673 8406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:46.862709 8406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:46.862732 8406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:46.864300 8406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:45089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=46723
--tserver_master_addrs=127.29.168.254:44939,127.29.168.253:45601,127.29.168.252:37687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:46.864482 8406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:46.864648 8406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:40:46.869159 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.866242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58092)
0808 14:40:46.866307 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.866318 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.866393 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.866600 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.866602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.866603 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.866655 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.866657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.867317 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.867318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.868108 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.868110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.868857 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.868858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.868926 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.868929 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.869008 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.869056 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 14:40:46.869182 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.866325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.29.168.252:37687)
0808 14:40:46.866401 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.866403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.866414 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:46.866444 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.866444 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.866481 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.866595 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.866737 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.867226 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.868200 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.868696 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.868775 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.868856 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.869018 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.869060 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:40:46.869613 7904 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
W20260808 14:40:46.869660 8421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.869756 8415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:46.869663 8419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:46.869884 7956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf85c793f92346ac8d36e21f8de1ea17. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.869987 7956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:40:46.870103 8406 server_base.cc:1034] running on GCE node
I20260808 14:40:46.870381 8406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:46.870617 8406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:46.871776 8406 hybrid_clock.cc:648] HybridClock initialized: now 1786200046871760 us; error 31 us; skew 500 ppm
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:46.874109 8406 init.cc:377] Logged in from keytab as oryx/127.29.168.195@KRBTEST.COM (short username oryx)
I20260808 14:40:46.874570 8406 webserver.cc:460] Webserver started at http://127.29.168.195:46723/ using document root <none> and password file <none>
I20260808 14:40:46.874830 8406 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:46.874914 8406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:46.876288 8406 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:46.876886 8436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.877063 8406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:46.877151 8406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "7fcfdc8956824afa9cb59d0fb697f6bf"
format_stamp: "Formatted at 2026-08-08 14:40:45 on dist-test-slave-mjjr"
server_key: "67a8fd95e08b6ef37046038397c07ade"
server_key_iv: "9f5ee83c2296e32cf8e0e9213cb3235d"
server_key_version: "encryptionkey@0"
I20260808 14:40:46.877435 8406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:46.896111 8406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:46.898211 8406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:46.898376 8406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:46.898579 8406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:46.898860 8406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:46.898892 8406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.898931 8406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:46.898977 8406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:46.904793 8406 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45089
I20260808 14:40:46.904892 8624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45089 every 8 connection(s)
I20260808 14:40:46.905185 8406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:46.906064 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 8406
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.252@KRBTEST.COM
I20260808 14:40:46.917761 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.907691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.29.168.253:45601)
0808 14:40:46.907806 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.907809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.908341 (+ 532us) server_negotiation.cc:407] Connection header received
0808 14:40:46.908415 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.908417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.908428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.908482 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.909229 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.909990 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911123 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.911431 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911488 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.913528 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.913529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.913529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.913536 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.916148 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.916628 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.916629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.916630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.916689 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.916890 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.916891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.916891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.917018 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.917109 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.917542 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.917627 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
I20260808 14:40:46.918322 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.907430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58102 (local address 127.29.168.252:37687)
0808 14:40:46.908242 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.908244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.908253 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:46.908299 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.908300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.908312 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.908369 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.909265 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.909975 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.912792 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.913120 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.913180 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.915089 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.915091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.915091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.915098 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.916931 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.917335 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.917336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.917336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.917397 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.917632 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.917633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.917634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.917754 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.917860 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.918162 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.918246 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":67,"threads_started":1}
I20260808 14:40:46.920172 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.905878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:56363 (local address 127.29.168.254:44939)
0808 14:40:46.906121 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.906123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.906234 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:40:46.907691 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.907692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.907705 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.907751 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.908732 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.909475 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911027 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.911320 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911386 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.914585 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.914586 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.914587 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.914595 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.916847 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919075 (+ 2228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.919077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.919077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.919128 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919414 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.919416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.919416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.919535 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.919593 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.920001 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.920079 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209}
I20260808 14:40:46.920347 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.905879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.29.168.195:59029)
0808 14:40:46.906380 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.906391 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.907547 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.907902 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.907905 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.908360 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.908624 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.908630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.909590 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.909591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.910923 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.910926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.911459 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.911598 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.912585 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.912595 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.917200 (+ 4605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.918988 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.918989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.918989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.919191 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.919372 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919374 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.919374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.919440 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.919775 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.919776 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.919845 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.919939 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.920105 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":61,"thread_start_us":94,"threads_started":1}
Aug 08 14:40:46 dist-test-slave-mjjr krb5kdc[6601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200046, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.253@KRBTEST.COM
I20260808 14:40:46.920723 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.905879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:56363)
0808 14:40:46.906074 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.906120 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.907542 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.907903 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.907906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.908389 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.908625 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.908630 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.909590 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.909591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.910923 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.910926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.911463 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911463 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.911598 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.912733 (+ 1135us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.912737 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.914470 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.918524 (+ 4054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.918532 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.918534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.918987 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.919197 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.919198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.919332 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.919640 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.919646 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.919834 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.920296 (+ 462us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.920392 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":68,"thread_start_us":97,"threads_started":1}
I20260808 14:40:46.920770 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.907099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:59029 (local address 127.29.168.252:37687)
0808 14:40:46.907155 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.907157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.907169 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:40:46.907711 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.907712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.907742 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.907789 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.908728 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.909466 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911051 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.911334 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.911400 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.917296 (+ 5896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.917298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.917298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.917306 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.918929 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919243 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.919244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.919244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.919296 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919508 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.919509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.919509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.919651 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.919746 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.920571 (+ 825us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.920673 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:40:46.921173 8626 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44939
I20260808 14:40:46.921252 8625 heartbeater.cc:347] Connected to a master server at 127.29.168.252:37687
I20260808 14:40:46.921284 8626 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.921304 8625 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.921463 8626 heartbeater.cc:511] Master 127.29.168.254:44939 requested a full tablet report, sending...
I20260808 14:40:46.921463 8625 heartbeater.cc:511] Master 127.29.168.252:37687 requested a full tablet report, sending...
I20260808 14:40:46.921888 6669 ts_manager.cc:194] Re-registered known tserver with Master: 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089)
I20260808 14:40:46.922132 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.907193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38884 (local address 127.29.168.254:44939)
0808 14:40:46.907471 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.907473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.908224 (+ 751us) server_negotiation.cc:407] Connection header received
0808 14:40:46.911863 (+ 3639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.911864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.911881 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.911952 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.913345 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.914067 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.915128 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.915441 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.915752 (+ 311us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.916789 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.916790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.916791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.916797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.919181 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.919709 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.919710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.919711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.919769 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.920001 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.920002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.920002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.920121 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.921877 (+ 1756us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.921923 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.922001 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":89,"threads_started":1}
I20260808 14:40:46.922215 6669 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:56363
I20260808 14:40:46.922477 7883 ts_manager.cc:194] Registered new tserver with Master: 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089)
I20260808 14:40:46.924033 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.906361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:47039 (local address 127.29.168.253:45601)
0808 14:40:46.906411 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.906413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.907351 (+ 938us) server_negotiation.cc:407] Connection header received
0808 14:40:46.907692 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.907693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.907705 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.907751 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.910093 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.910817 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.913260 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.913778 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.914037 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.921069 (+ 7032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.921070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.921071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.921078 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.922935 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.923265 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.923266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.923267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.923333 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.923547 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.923547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.923548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.923682 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.923750 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.923909 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.923978 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:40:46.924079 8630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.906165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.29.168.195:47039)
0808 14:40:46.907258 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.907268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.907542 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.907903 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.907906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.908493 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:46.908625 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.908631 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.910923 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.910924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.911769 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.911772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.917536 (+ 5764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.917537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.917607 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.919281 (+ 1674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:46.919286 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:46.920971 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:46.923012 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.923013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.923014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.923210 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.923406 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:46.923407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:46.923407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:46.923468 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:46.923746 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:46.923747 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:46.923796 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.923869 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.923974 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"thread_start_us":57,"threads_started":1}
I20260808 14:40:46.924366 8627 heartbeater.cc:347] Connected to a master server at 127.29.168.253:45601
I20260808 14:40:46.924402 8627 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:46.924446 8627 heartbeater.cc:511] Master 127.29.168.253:45601 requested a full tablet report, sending...
I20260808 14:40:46.924698 7603 ts_manager.cc:194] Registered new tserver with Master: 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089)
I20260808 14:40:46.923995 6667 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:46.925787 6667 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:46.926378 7837 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: NON_VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: true } } }
I20260808 14:40:46.926463 7837 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.927716 7837 raft_consensus.cc:1050] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: attempting to promote NON_VOTER 04aae7c4f7c04079bed5a3a48fd57ed8 to VOTER
I20260808 14:40:46.927887 7837 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } }
I20260808 14:40:46.928462 7619 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Refusing update from remote peer bf85c793f92346ac8d36e21f8de1ea17: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:40:46.928473 7904 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 LEARNER]: Refusing update from remote peer bf85c793f92346ac8d36e21f8de1ea17: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:40:46.928653 7539 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 14:40:46.928733 7538 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:40:46.929466 8660 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.929680 7619 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.929725 7904 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.930406 8660 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.930478 8660 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.930554 7840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.930694 7840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:46.930684 7538 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.930749 7538 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.930814 7538 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.930805 7956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf85c793f92346ac8d36e21f8de1ea17" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:46.930881 7538 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:46.930882 7956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:46.935531 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.931780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:42173 (local address 127.0.0.1:33510)
0808 14:40:46.931823 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.931833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.931868 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.932405 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.932407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.932408 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.932448 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.932450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.933638 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.933639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.934396 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.934398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.935321 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.935322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.935378 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.935381 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.935443 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.935477 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:40:46.935565 8667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.932034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33510 (local address 127.29.168.193:42173)
0808 14:40:46.932202 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.932207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.932219 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:40:46.932259 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.932261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.932279 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.932531 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.932603 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.933526 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.934507 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.935240 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.935322 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.935390 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.935456 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.935491 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260808 14:40:46.936067 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.932026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60186 (local address 127.29.168.195:45089)
0808 14:40:46.932440 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.932444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.932452 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:46.932483 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.932485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.932499 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.932566 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.932720 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.933783 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.935119 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.935731 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.935831 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.935876 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.935956 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.935996 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":121,"threads_started":1}
I20260808 14:40:46.936079 8665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.931814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45089 (local address 127.0.0.1:60186)
0808 14:40:46.931948 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.931956 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.932118 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.932614 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.932615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.932617 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.932660 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.932662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.933895 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.933896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.935027 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.935029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.935817 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.935818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.935874 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.935878 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.935940 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.936009 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260808 14:40:46.936568 8663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.931815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43695 (local address 127.0.0.1:57106)
0808 14:40:46.932201 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.932210 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.932242 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.932561 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.932562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.932563 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.932604 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.932606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.933970 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.933970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.935027 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.935029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.936358 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.936359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.936417 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.936421 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.936472 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.936507 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":4,"thread_start_us":84,"threads_started":1}
I20260808 14:40:46.936591 8674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.932241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57106 (local address 127.29.168.194:43695)
0808 14:40:46.932421 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.932425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.932433 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:46.932464 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.932465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.932476 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.932563 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.932660 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.933890 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.935401 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.936259 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.936354 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.936402 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.936485 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.936520 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":87,"threads_started":1}
I20260808 14:40:46.936568 8069 tablet_service.cc:1467] Processing CreateTablet for tablet 6208586c50c348f69c848833c82774d6 (DEFAULT_TABLE table=test-table [id=2c86c159683a4846a196b6c79c55b06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:46.936599 8511 tablet_service.cc:1467] Processing CreateTablet for tablet 6208586c50c348f69c848833c82774d6 (DEFAULT_TABLE table=test-table [id=2c86c159683a4846a196b6c79c55b06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:46.936894 8069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6208586c50c348f69c848833c82774d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:46.936894 8511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6208586c50c348f69c848833c82774d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:46.937142 8276 tablet_service.cc:1467] Processing CreateTablet for tablet 6208586c50c348f69c848833c82774d6 (DEFAULT_TABLE table=test-table [id=2c86c159683a4846a196b6c79c55b06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:46.937402 8276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6208586c50c348f69c848833c82774d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:46.940025 8676 tablet_bootstrap.cc:492] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Bootstrap starting.
I20260808 14:40:46.940232 8677 tablet_bootstrap.cc:492] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Bootstrap starting.
I20260808 14:40:46.940665 8676 tablet_bootstrap.cc:654] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:46.940846 8677 tablet_bootstrap.cc:654] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:46.941007 8676 log.cc:824] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:46.941150 8677 log.cc:824] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:46.941381 8678 tablet_bootstrap.cc:492] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Bootstrap starting.
I20260808 14:40:46.941946 8676 tablet_bootstrap.cc:492] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: No bootstrap required, opened a new log
I20260808 14:40:46.942047 8678 tablet_bootstrap.cc:654] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:46.942047 8676 ts_tablet_manager.cc:1397] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:46.942366 8678 log.cc:824] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:46.943172 8677 tablet_bootstrap.cc:492] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: No bootstrap required, opened a new log
I20260808 14:40:46.943248 8677 ts_tablet_manager.cc:1397] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:40:46.943271 8678 tablet_bootstrap.cc:492] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: No bootstrap required, opened a new log
I20260808 14:40:46.943325 8678 ts_tablet_manager.cc:1397] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:46.944615 8676 raft_consensus.cc:348] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.944792 8676 raft_consensus.cc:374] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:46.944828 8676 raft_consensus.cc:729] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cae014b9a124685b31d33c70e94e170, State: Initialized, Role: FOLLOWER
I20260808 14:40:46.944933 8676 consensus_queue.cc:260] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.945211 8399 heartbeater.cc:503] Master 127.29.168.254:44939 was elected leader, sending a full tablet report...
I20260808 14:40:46.945057 8677 raft_consensus.cc:348] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.945170 8676 ts_tablet_manager.cc:1428] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 14:40:46.945438 8677 raft_consensus.cc:374] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:46.945485 8677 raft_consensus.cc:729] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18527c8589eb47a5907b96c58659e3fe, State: Initialized, Role: FOLLOWER
I20260808 14:40:46.945609 8677 consensus_queue.cc:260] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.945865 8677 ts_tablet_manager.cc:1428] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:40:46.946143 8171 heartbeater.cc:503] Master 127.29.168.254:44939 was elected leader, sending a full tablet report...
I20260808 14:40:46.946925 8678 raft_consensus.cc:348] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.947072 8678 raft_consensus.cc:374] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:46.947113 8678 raft_consensus.cc:729] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fcfdc8956824afa9cb59d0fb697f6bf, State: Initialized, Role: FOLLOWER
I20260808 14:40:46.947234 8678 consensus_queue.cc:260] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.947453 8678 ts_tablet_manager.cc:1428] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 14:40:46.947503 8626 heartbeater.cc:503] Master 127.29.168.254:44939 was elected leader, sending a full tablet report...
I20260808 14:40:46.951380 8685 raft_consensus.cc:482] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:46.951478 8685 raft_consensus.cc:504] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.951807 8685 leader_election.cc:288] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089), 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695)
I20260808 14:40:46.954571 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.952006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:32891 (local address 127.29.168.195:45089)
0808 14:40:46.952039 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.952041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.952048 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:46.952067 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.952068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.952093 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.952147 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.952293 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.952727 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.953823 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.954218 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.954303 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.954310 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.954470 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.954501 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:46.954566 8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.951918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45089 (local address 127.29.168.193:32891)
0808 14:40:46.951958 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.951970 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.952008 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.952163 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.952164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.952165 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.952225 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.952226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.952814 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.952815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.953706 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.953709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.954301 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.954303 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.954376 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.954379 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.954462 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.954502 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 14:40:46.954658 8674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.952012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:41465 (local address 127.29.168.194:43695)
0808 14:40:46.952130 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.952131 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.952137 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:46.952153 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.952153 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.952160 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.952220 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:46.952369 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.952795 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.953905 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.954251 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.954340 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.954347 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.954555 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.954593 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 14:40:46.954694 8176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.951953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43695 (local address 127.29.168.193:41465)
0808 14:40:46.951999 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:46.952010 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:46.952045 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:46.952236 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:46.952238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:46.952239 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:46.952294 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.952295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.952879 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.952881 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.953790 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:46.953793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.954340 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.954341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:46.954432 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.954435 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:46.954510 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:40:46.954562 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:40:46.954912 8548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6208586c50c348f69c848833c82774d6" candidate_uuid: "18527c8589eb47a5907b96c58659e3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" is_pre_election: true
I20260808 14:40:46.955003 8315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6208586c50c348f69c848833c82774d6" candidate_uuid: "18527c8589eb47a5907b96c58659e3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cae014b9a124685b31d33c70e94e170" is_pre_election: true
I20260808 14:40:46.955041 8548 raft_consensus.cc:2454] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18527c8589eb47a5907b96c58659e3fe in term 0.
I20260808 14:40:46.955125 8315 raft_consensus.cc:2454] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18527c8589eb47a5907b96c58659e3fe in term 0.
I20260808 14:40:46.955282 8005 leader_election.cc:302] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18527c8589eb47a5907b96c58659e3fe, 7fcfdc8956824afa9cb59d0fb697f6bf; no voters:
I20260808 14:40:46.955410 8685 raft_consensus.cc:2781] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:46.955462 8685 raft_consensus.cc:482] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:46.955513 8685 raft_consensus.cc:3037] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:46.956154 8685 raft_consensus.cc:504] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.956300 8685 leader_election.cc:288] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [CANDIDATE]: Term 1 election: Requested vote from peers 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089), 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695)
I20260808 14:40:46.956452 8548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6208586c50c348f69c848833c82774d6" candidate_uuid: "18527c8589eb47a5907b96c58659e3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf"
I20260808 14:40:46.956511 8315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6208586c50c348f69c848833c82774d6" candidate_uuid: "18527c8589eb47a5907b96c58659e3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cae014b9a124685b31d33c70e94e170"
I20260808 14:40:46.956516 8548 raft_consensus.cc:3037] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:46.956597 8315 raft_consensus.cc:3037] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:46.957237 8548 raft_consensus.cc:2454] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18527c8589eb47a5907b96c58659e3fe in term 1.
I20260808 14:40:46.957245 8315 raft_consensus.cc:2454] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18527c8589eb47a5907b96c58659e3fe in term 1.
I20260808 14:40:46.957401 8005 leader_election.cc:302] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18527c8589eb47a5907b96c58659e3fe, 7fcfdc8956824afa9cb59d0fb697f6bf; no voters:
I20260808 14:40:46.957506 8685 raft_consensus.cc:2781] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:46.957670 8685 raft_consensus.cc:686] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 1 LEADER]: Becoming Leader. State: Replica: 18527c8589eb47a5907b96c58659e3fe, State: Running, Role: LEADER
I20260808 14:40:46.957779 8685 consensus_queue.cc:237] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:46.958619 6669 catalog_manager.cc:5495] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 18527c8589eb47a5907b96c58659e3fe (127.29.168.193). New cstate: current_term: 1 leader_uuid: "18527c8589eb47a5907b96c58659e3fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:46.969563 8667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.967162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33522 (local address 127.29.168.193:42173)
0808 14:40:46.967207 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.967209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.967218 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:46.967294 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.967295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.967311 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.967408 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:46.967509 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.968036 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.968803 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.969003 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.969079 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.969244 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:46.969346 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:46.969436 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.969479 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.969496 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:40:46.971179 8548 raft_consensus.cc:1261] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Refusing update from remote peer 18527c8589eb47a5907b96c58659e3fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:46.971179 8315 raft_consensus.cc:1261] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Refusing update from remote peer 18527c8589eb47a5907b96c58659e3fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:46.971553 8687 consensus_queue.cc:1035] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:46.971729 8685 consensus_queue.cc:1035] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:46.974639 8692 mvcc.cc:205] Tried to move back new op lower bound from 7316275392391340032 to 7316275392339558400. Current Snapshot: MvccSnapshot[applied={T|T < 7316275392391340032}]
I20260808 14:40:46.976850 6669 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:46.976934 6669 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:46.978075 6669 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf85c793f92346ac8d36e21f8de1ea17: Sending DeleteTablet for 3 replicas of tablet 6208586c50c348f69c848833c82774d6
I20260808 14:40:46.978374 8511 tablet_service.cc:1514] Processing DeleteTablet for tablet 6208586c50c348f69c848833c82774d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:46 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:60186
I20260808 14:40:46.978410 8276 tablet_service.cc:1514] Processing DeleteTablet for tablet 6208586c50c348f69c848833c82774d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:46 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:57106
I20260808 14:40:46.978645 8708 tablet_replica.cc:330] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: stopping tablet replica
I20260808 14:40:46.978745 8708 raft_consensus.cc:2229] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:46.978842 8708 raft_consensus.cc:2258] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:46.979255 8069 tablet_service.cc:1514] Processing DeleteTablet for tablet 6208586c50c348f69c848833c82774d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:46 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:33510
I20260808 14:40:46.979329 8708 ts_tablet_manager.cc:1905] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:46.980408 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 6617
I20260808 14:40:46.985838 8708 ts_tablet_manager.cc:1918] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:46.985957 8708 log.cc:1196] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/6208586c50c348f69c848833c82774d6
I20260808 14:40:46.986306 8708 ts_tablet_manager.cc:1939] T 6208586c50c348f69c848833c82774d6 P 6cae014b9a124685b31d33c70e94e170: Deleting consensus metadata
I20260808 14:40:46.990106 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.979809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58106 (local address 127.29.168.252:37687)
0808 14:40:46.979847 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.979849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.980055 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:40:46.980144 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.980145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.980155 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.980183 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:46.982994 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.983764 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.984905 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:46.985238 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:46.985278 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:46.987188 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:46.987189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:46.987190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:46.987197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:46.988893 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.989261 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.989262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.989263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.989319 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:46.989513 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:46.989514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:46.989514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:46.989664 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:46.989734 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:46.989940 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 14:40:46.990013 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:46.991755 8710 tablet_replica.cc:330] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: stopping tablet replica
I20260808 14:40:46.991885 8710 raft_consensus.cc:2229] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:46.991972 8710 raft_consensus.cc:2258] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:46.996057 8710 ts_tablet_manager.cc:1905] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:46.996270 8709 tablet_replica.cc:330] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: stopping tablet replica
I20260808 14:40:46.996416 8709 raft_consensus.cc:2229] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 14:40:46.996456 8208 connection.cc:535] server connection from 127.0.0.1:57106 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:40:46.996629 8709 raft_consensus.cc:2258] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:46.997267 8709 ts_tablet_manager.cc:1905] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:46.997746 8710 ts_tablet_manager.cc:1918] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:46.997833 8710 log.cc:1196] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/6208586c50c348f69c848833c82774d6
I20260808 14:40:46.998101 8710 ts_tablet_manager.cc:1939] T 6208586c50c348f69c848833c82774d6 P 18527c8589eb47a5907b96c58659e3fe: Deleting consensus metadata
W20260808 14:40:46.998404 8005 connection.cc:441] server connection from 127.0.0.1:33510 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33510 (request call id 1) could send its response
I20260808 14:40:46.999375 8709 ts_tablet_manager.cc:1918] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:46.999447 8709 log.cc:1196] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/6208586c50c348f69c848833c82774d6
I20260808 14:40:46.999764 8709 ts_tablet_manager.cc:1939] T 6208586c50c348f69c848833c82774d6 P 7fcfdc8956824afa9cb59d0fb697f6bf: Deleting consensus metadata
W20260808 14:40:47.000162 8437 connection.cc:441] server connection from 127.0.0.1:60186 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60186 (request call id 1) could send its response
I20260808 14:40:47.006318 8179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.999079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58108 (local address 127.29.168.252:37687)
0808 14:40:46.999111 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.999112 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.999318 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:40:46.999385 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.999386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.999397 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.999452 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:47.000553 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:47.001009 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:47.001758 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:47.002020 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:47.002054 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:47.003358 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:47.003359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:47.003359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:47.003365 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:47.005021 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:47.005361 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:47.005363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:47.005363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:47.005422 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:47.005669 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:47.005670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:47.005671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:47.005806 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:47.005960 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:47.006128 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:40:47.006205 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:47.007510 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:46.999079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55250 (local address 127.29.168.253:45601)
0808 14:40:46.999120 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:46.999122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:46.999128 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:46.999149 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:46.999150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:46.999159 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:46.999209 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:47.000677 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:47.001365 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:47.002242 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:47.002782 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:47.002859 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:47.004524 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:47.004525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:47.004525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:47.004532 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:47.006371 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:47.006759 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:47.006760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:47.006760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:47.006852 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:47.007071 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:47.007072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:47.007073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:47.007189 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:47.007258 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:47.007393 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:40:47.007451 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:40:47.975766 8723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:47.975280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:57323)
0808 14:40:47.975502 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:47.975707 (+ 205us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":61,"threads_started":1}
I20260808 14:40:47.975868 8724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:47.975596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:37489)
0808 14:40:47.975741 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:47.975819 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
W20260808 14:40:47.976060 8171 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:44939 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
W20260808 14:40:47.976274 8626 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:44939 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:47.977267 8726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:47.976982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:40135)
0808 14:40:47.977140 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:47.977204 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":56,"threads_started":1}
W20260808 14:40:47.977427 8399 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:44939 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:48.478487 8728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf85c793f92346ac8d36e21f8de1ea17)
I20260808 14:40:48.478605 8728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } }
I20260808 14:40:48.478845 8728 leader_election.cc:288] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939), 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252:37687)
I20260808 14:40:48.479136 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.478939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39326)
0808 14:40:48.479041 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.479092 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":42,"threads_started":1}
W20260808 14:40:48.479305 7579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:48.479362 8733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf85c793f92346ac8d36e21f8de1ea17)
I20260808 14:40:48.479482 8733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } }
I20260808 14:40:48.479864 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.479767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39338)
0808 14:40:48.479818 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.479840 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:40:48.479955 8733 leader_election.cc:288] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939), 40f1f05fdb21478387d8bfa30b6176f7 (127.29.168.253:45601)
W20260808 14:40:48.480023 7579 leader_election.cc:334] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939): Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:48.480064 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.479857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39346)
0808 14:40:48.479975 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.480027 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":56,"threads_started":1}
W20260808 14:40:48.480206 7874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:48.480670 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.480566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39352)
0808 14:40:48.480611 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.480636 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:40:48.480868 7874 leader_election.cc:334] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939): Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:48.482754 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.478996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37687 (local address 127.0.0.1:58114)
0808 14:40:48.479115 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.479125 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.479208 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.479508 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.479510 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.479512 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.479573 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.479575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.480874 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.480875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.481861 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.481864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.482539 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.482539 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.482589 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.482592 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.482632 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.482664 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":53,"threads_started":1}
I20260808 14:40:48.482789 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.479136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.29.168.252:37687)
0808 14:40:48.479327 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.479329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.479336 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:48.479388 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.479389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.479400 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.479484 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.479698 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.480790 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.481953 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.482451 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.482534 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.482543 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.482658 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.482708 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":79,"threads_started":1}
I20260808 14:40:48.482983 7904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40f1f05fdb21478387d8bfa30b6176f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" is_pre_election: true
I20260808 14:40:48.483080 7904 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40f1f05fdb21478387d8bfa30b6176f7 in term 1.
I20260808 14:40:48.483222 7576 leader_election.cc:302] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04aae7c4f7c04079bed5a3a48fd57ed8, 40f1f05fdb21478387d8bfa30b6176f7; no voters: bf85c793f92346ac8d36e21f8de1ea17
I20260808 14:40:48.483330 8728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:40:48.483377 8728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf85c793f92346ac8d36e21f8de1ea17)
I20260808 14:40:48.483405 8728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:40:48.484280 8728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } }
I20260808 14:40:48.484422 8728 leader_election.cc:288] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [CANDIDATE]: Term 2 election: Requested vote from peers bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939), 04aae7c4f7c04079bed5a3a48fd57ed8 (127.29.168.252:37687)
I20260808 14:40:48.484557 7904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40f1f05fdb21478387d8bfa30b6176f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8"
I20260808 14:40:48.484589 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.484505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39376)
0808 14:40:48.484537 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.484569 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 14:40:48.484635 7904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:40:48.484784 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.479865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45601 (local address 127.0.0.1:55262)
0808 14:40:48.480052 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.480060 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.480106 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.480341 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.480342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.480344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.480423 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.480425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.481547 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.481548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.482608 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.482610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.484500 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.484501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.484567 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.484572 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.484633 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.484679 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":52,"threads_started":1}
I20260808 14:40:48.484795 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.479898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55262 (local address 127.29.168.253:45601)
0808 14:40:48.480167 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.480169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.480177 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:48.480197 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.480198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.480206 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.480279 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.480624 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.481478 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.482715 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.483229 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.483297 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.483305 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.484688 (+ 1383us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.484739 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":85,"threads_started":1}
I20260808 14:40:48.485014 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.484916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39382)
0808 14:40:48.484967 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.484995 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 14:40:48.485092 7579 leader_election.cc:334] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939): Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
I20260808 14:40:48.485507 7904 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40f1f05fdb21478387d8bfa30b6176f7 in term 2.
I20260808 14:40:48.485697 7576 leader_election.cc:302] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04aae7c4f7c04079bed5a3a48fd57ed8, 40f1f05fdb21478387d8bfa30b6176f7; no voters: bf85c793f92346ac8d36e21f8de1ea17
I20260808 14:40:48.485793 8728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:40:48.485795 7619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "40f1f05fdb21478387d8bfa30b6176f7" is_pre_election: true
I20260808 14:40:48.485929 8728 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [term 2 LEADER]: Becoming Leader. State: Replica: 40f1f05fdb21478387d8bfa30b6176f7, State: Running, Role: LEADER
I20260808 14:40:48.485992 8728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } }
I20260808 14:40:48.486337 8742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40f1f05fdb21478387d8bfa30b6176f7. Latest consensus state: current_term: 2 leader_uuid: "40f1f05fdb21478387d8bfa30b6176f7" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:48.486416 8742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:48.486496 7871 leader_election.cc:302] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04aae7c4f7c04079bed5a3a48fd57ed8; no voters: 40f1f05fdb21478387d8bfa30b6176f7, bf85c793f92346ac8d36e21f8de1ea17
I20260808 14:40:48.486660 8733 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:40:48.486646 8749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:48.487116 8749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:48.487180 8749 catalog_manager.cc:1259] Loaded cluster ID: 77744ce3de4346f297104d0087817ddd
I20260808 14:40:48.487197 8749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:48.487319 8749 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:48.487373 8749 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Loaded TSK: 0
I20260808 14:40:48.487463 8749 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:40:48.543799 7603 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:48.545536 7603 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:48.546588 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.546478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39400)
0808 14:40:48.546530 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.546560 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 14:40:48.546600 7904 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [term 2 FOLLOWER]: Refusing update from remote peer 40f1f05fdb21478387d8bfa30b6176f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 14:40:48.546906 8728 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 14:40:48.547041 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.546940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.0.0.1:39412)
0808 14:40:48.546991 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.547021 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:40:48.547152 7579 consensus_peers.cc:487] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 -> Peer bf85c793f92346ac8d36e21f8de1ea17 (127.29.168.254:44939): Couldn't send request to peer bf85c793f92346ac8d36e21f8de1ea17. Status: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:40:48.547494 8733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40f1f05fdb21478387d8bfa30b6176f7. Latest consensus state: current_term: 2 leader_uuid: "40f1f05fdb21478387d8bfa30b6176f7" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:48.547605 8733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:48.548031 8742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "40f1f05fdb21478387d8bfa30b6176f7" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:48.548120 8742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:48.548600 8751 mvcc.cc:205] Tried to move back new op lower bound from 7316275398844596224 to 7316275398599045120. Current Snapshot: MvccSnapshot[applied={T|T < 7316275398844596224}]
I20260808 14:40:48.548759 8733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "40f1f05fdb21478387d8bfa30b6176f7" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "bf85c793f92346ac8d36e21f8de1ea17" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44939 } } peers { permanent_uuid: "40f1f05fdb21478387d8bfa30b6176f7" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45601 } attrs { promote: false } } peers { permanent_uuid: "04aae7c4f7c04079bed5a3a48fd57ed8" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37687 } attrs { promote: false } } }
I20260808 14:40:48.548858 8733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04aae7c4f7c04079bed5a3a48fd57ed8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:40:48.552853 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.549744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:42173 (local address 127.0.0.1:33534)
0808 14:40:48.549855 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.549866 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.549923 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.550278 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.550279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.550280 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.550315 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.550316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.551260 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.551261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.552036 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.552038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.552684 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.552685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.552730 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.552732 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.552781 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.552809 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":2}
I20260808 14:40:48.552909 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.549854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.29.168.193:42173)
0808 14:40:48.550146 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.550149 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.550156 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:40:48.550182 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.550183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.550193 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.550391 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.550431 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.551167 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.552118 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.552613 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.552683 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.552691 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.552804 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.552839 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":82,"threads_started":1}
I20260808 14:40:48.553347 8069 tablet_service.cc:1467] Processing CreateTablet for tablet cf04c7a360234184a8ae5a12d6299e10 (DEFAULT_TABLE table=test-table [id=0d6c8da88d1e4984a2610d0abff2524e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:48.553495 8069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf04c7a360234184a8ae5a12d6299e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:48.553846 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.549715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45089 (local address 127.0.0.1:60198)
0808 14:40:48.549756 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.549765 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.549800 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.550211 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.550212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.550214 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.550264 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.550266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.551251 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.551252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.552272 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.552274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.553598 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.553599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.553658 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.553663 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.553748 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.553787 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":17}
I20260808 14:40:48.553879 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.549926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60198 (local address 127.29.168.195:45089)
0808 14:40:48.550061 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.550063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.550072 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:48.550098 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.550099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.550112 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.550330 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.550370 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.551177 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.553077 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.553514 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.553604 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.553613 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.553766 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.553808 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260808 14:40:48.553989 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.550098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57118 (local address 127.29.168.194:43695)
0808 14:40:48.550217 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.550219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.550227 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:48.550254 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.550255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.550265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.550324 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.550488 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.550975 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.552345 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.552958 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.553030 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.553038 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.553882 (+ 844us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.553925 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":68,"threads_started":1}
I20260808 14:40:48.554252 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.549767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43695 (local address 127.0.0.1:57118)
0808 14:40:48.549897 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.549913 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.549952 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.550372 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.550373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.550381 (+ 8us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.550415 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.550417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.551058 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.551059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.552243 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.552245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.553658 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.553659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.553733 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.553738 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.553789 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.553836 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":23,"thread_start_us":87,"threads_started":1}
I20260808 14:40:48.554571 8276 tablet_service.cc:1467] Processing CreateTablet for tablet cf04c7a360234184a8ae5a12d6299e10 (DEFAULT_TABLE table=test-table [id=0d6c8da88d1e4984a2610d0abff2524e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:48.554725 8276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf04c7a360234184a8ae5a12d6299e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:48.555107 8760 tablet_bootstrap.cc:492] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe: Bootstrap starting.
I20260808 14:40:48.555341 8511 tablet_service.cc:1467] Processing CreateTablet for tablet cf04c7a360234184a8ae5a12d6299e10 (DEFAULT_TABLE table=test-table [id=0d6c8da88d1e4984a2610d0abff2524e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:48.555455 8511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf04c7a360234184a8ae5a12d6299e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:48.555509 8760 tablet_bootstrap.cc:654] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:48.556123 8760 tablet_bootstrap.cc:492] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe: No bootstrap required, opened a new log
I20260808 14:40:48.556200 8760 ts_tablet_manager.cc:1397] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:48.556377 8764 tablet_bootstrap.cc:492] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Bootstrap starting.
I20260808 14:40:48.556417 8760 raft_consensus.cc:348] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.556488 8760 raft_consensus.cc:374] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:48.556509 8760 raft_consensus.cc:729] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18527c8589eb47a5907b96c58659e3fe, State: Initialized, Role: FOLLOWER
I20260808 14:40:48.556564 8760 consensus_queue.cc:260] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.556705 8760 ts_tablet_manager.cc:1428] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:48.556748 8764 tablet_bootstrap.cc:654] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:48.557113 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.556912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:52497)
0808 14:40:48.557040 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.557074 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":76,"threads_started":1}
I20260808 14:40:48.557307 8766 tablet_bootstrap.cc:492] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Bootstrap starting.
I20260808 14:40:48.557591 8172 heartbeater.cc:503] Master 127.29.168.253:45601 was elected leader, sending a full tablet report...
I20260808 14:40:48.557767 8766 tablet_bootstrap.cc:654] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:48.558102 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.557419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:34477)
0808 14:40:48.558047 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.558083 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612}
I20260808 14:40:48.558394 8766 tablet_bootstrap.cc:492] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: No bootstrap required, opened a new log
I20260808 14:40:48.558447 8766 ts_tablet_manager.cc:1397] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:48.558529 8764 tablet_bootstrap.cc:492] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: No bootstrap required, opened a new log
I20260808 14:40:48.558538 8766 raft_consensus.cc:348] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.558585 8764 ts_tablet_manager.cc:1397] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:48.558640 8766 raft_consensus.cc:374] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:48.558668 8766 raft_consensus.cc:729] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fcfdc8956824afa9cb59d0fb697f6bf, State: Initialized, Role: FOLLOWER
I20260808 14:40:48.558734 8766 consensus_queue.cc:260] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.558774 8764 raft_consensus.cc:348] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.558849 8764 raft_consensus.cc:374] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:48.558878 8764 raft_consensus.cc:729] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cae014b9a124685b31d33c70e94e170, State: Initialized, Role: FOLLOWER
I20260808 14:40:48.558890 8766 ts_tablet_manager.cc:1428] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:48.559165 8764 consensus_queue.cc:260] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.559355 8764 ts_tablet_manager.cc:1428] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:48.559568 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.559082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:37579)
0808 14:40:48.559499 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.559532 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":76,"threads_started":1}
I20260808 14:40:48.560039 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.559881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:51571)
0808 14:40:48.559990 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.560013 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260808 14:40:48.560056 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.559538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:51175)
0808 14:40:48.559984 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.560022 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":86,"threads_started":1}
I20260808 14:40:48.560322 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.560234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:37545)
0808 14:40:48.560280 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.560302 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:40:48.608980 8175 tablet.cc:2369] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:48.627223 8776 raft_consensus.cc:482] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:48.627292 8776 raft_consensus.cc:504] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.627629 8776 leader_election.cc:288] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089), 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173)
I20260808 14:40:48.630165 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.627882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:51829 (local address 127.29.168.195:45089)
0808 14:40:48.627920 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.627922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.627946 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:40:48.627970 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.627971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.627980 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.628028 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.628196 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.628650 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.629544 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.629868 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.629944 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.629953 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.630079 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.630111 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:40:48.630183 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.627793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45089 (local address 127.29.168.194:51829)
0808 14:40:48.627845 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.627855 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.627903 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.628041 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.628042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.628044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.628112 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.628113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.628730 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.628730 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.629454 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.629456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.629945 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.629946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.630009 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.630012 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.630072 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.630108 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:40:48.630491 8548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf04c7a360234184a8ae5a12d6299e10" candidate_uuid: "6cae014b9a124685b31d33c70e94e170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" is_pre_election: true
I20260808 14:40:48.630607 8548 raft_consensus.cc:2454] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cae014b9a124685b31d33c70e94e170 in term 0.
I20260808 14:40:48.630780 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.627881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:44875 (local address 127.29.168.193:42173)
0808 14:40:48.627920 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.627922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.628070 (+ 148us) server_negotiation.cc:407] Connection header received
0808 14:40:48.628136 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.628137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.628145 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.628228 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:48.628379 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.629004 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.629943 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.630400 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.630480 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.630490 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.630669 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.630709 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:40:48.630789 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.627810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:42173 (local address 127.29.168.194:44875)
0808 14:40:48.627983 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.627997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:48.628079 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:48.628232 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:48.628233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:48.628234 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:48.628279 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.628281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.629127 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.629128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.629847 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:48.629849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.630494 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.630495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:48.630581 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.630584 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:48.630648 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:40:48.630689 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":97,"threads_started":1}
I20260808 14:40:48.630793 8207 leader_election.cc:302] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cae014b9a124685b31d33c70e94e170, 7fcfdc8956824afa9cb59d0fb697f6bf; no voters:
I20260808 14:40:48.630981 8776 raft_consensus.cc:2781] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:48.631032 8776 raft_consensus.cc:482] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:48.631057 8776 raft_consensus.cc:3037] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:48.631011 8096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf04c7a360234184a8ae5a12d6299e10" candidate_uuid: "6cae014b9a124685b31d33c70e94e170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18527c8589eb47a5907b96c58659e3fe" is_pre_election: true
I20260808 14:40:48.631150 8096 raft_consensus.cc:2454] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cae014b9a124685b31d33c70e94e170 in term 0.
I20260808 14:40:48.631942 8776 raft_consensus.cc:504] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.632113 8776 leader_election.cc:288] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [CANDIDATE]: Term 1 election: Requested vote from peers 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089), 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173)
I20260808 14:40:48.632229 8548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf04c7a360234184a8ae5a12d6299e10" candidate_uuid: "6cae014b9a124685b31d33c70e94e170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf"
I20260808 14:40:48.632306 8548 raft_consensus.cc:3037] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:48.632273 8096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf04c7a360234184a8ae5a12d6299e10" candidate_uuid: "6cae014b9a124685b31d33c70e94e170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18527c8589eb47a5907b96c58659e3fe"
I20260808 14:40:48.632383 8096 raft_consensus.cc:3037] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:48.632946 8548 raft_consensus.cc:2454] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cae014b9a124685b31d33c70e94e170 in term 1.
I20260808 14:40:48.633090 8096 raft_consensus.cc:2454] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cae014b9a124685b31d33c70e94e170 in term 1.
I20260808 14:40:48.633102 8207 leader_election.cc:302] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cae014b9a124685b31d33c70e94e170, 7fcfdc8956824afa9cb59d0fb697f6bf; no voters:
I20260808 14:40:48.633276 8776 raft_consensus.cc:2781] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:48.633415 8776 raft_consensus.cc:686] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 1 LEADER]: Becoming Leader. State: Replica: 6cae014b9a124685b31d33c70e94e170, State: Running, Role: LEADER
I20260808 14:40:48.633548 8776 consensus_queue.cc:237] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } }
I20260808 14:40:48.633586 8400 heartbeater.cc:503] Master 127.29.168.253:45601 was elected leader, sending a full tablet report...
I20260808 14:40:48.633867 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.633645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:47069)
0808 14:40:48.633811 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.633843 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260808 14:40:48.634357 7603 catalog_manager.cc:5495] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cae014b9a124685b31d33c70e94e170 (127.29.168.194). New cstate: current_term: 1 leader_uuid: "6cae014b9a124685b31d33c70e94e170" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cae014b9a124685b31d33c70e94e170" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43695 } health_report { overall_health: HEALTHY } } }
I20260808 14:40:48.644445 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.642030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57134 (local address 127.29.168.194:43695)
0808 14:40:48.642085 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:48.642087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:48.642096 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:48.642146 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:48.642147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:48.642164 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:48.642231 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:48.642332 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.642810 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.643553 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:48.643888 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:48.643961 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:48.644126 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:48.644229 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:48.644318 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:48.644359 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 14:40:48.644377 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:40:48.645401 8548 raft_consensus.cc:1261] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Refusing update from remote peer 6cae014b9a124685b31d33c70e94e170: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:48.645427 8096 raft_consensus.cc:1261] T cf04c7a360234184a8ae5a12d6299e10 P 18527c8589eb47a5907b96c58659e3fe [term 1 FOLLOWER]: Refusing update from remote peer 6cae014b9a124685b31d33c70e94e170: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:48.645627 8780 consensus_queue.cc:1035] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fcfdc8956824afa9cb59d0fb697f6bf" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:48.645747 8776 consensus_queue.cc:1035] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18527c8589eb47a5907b96c58659e3fe" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 42173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:48.646464 8627 heartbeater.cc:503] Master 127.29.168.253:45601 was elected leader, sending a full tablet report...
I20260808 14:40:48.646615 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.646332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:44157)
0808 14:40:48.646557 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.646587 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260808 14:40:48.646677 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.646372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:44073)
0808 14:40:48.646599 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.646629 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
I20260808 14:40:48.647871 8785 mvcc.cc:205] Tried to move back new op lower bound from 7316275399249813504 to 7316275399203762176. Current Snapshot: MvccSnapshot[applied={T|T < 7316275399249813504}]
I20260808 14:40:48.648029 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.647917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:49321)
0808 14:40:48.647977 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.648005 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:40:48.648043 8783 mvcc.cc:205] Tried to move back new op lower bound from 7316275399249813504 to 7316275399203762176. Current Snapshot: MvccSnapshot[applied={T|T < 7316275399249813504}]
I20260808 14:40:48.648370 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.648277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.193:42759)
0808 14:40:48.648325 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.648347 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:40:48.648664 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.648582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.195:55369)
0808 14:40:48.648618 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.648639 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:40:48.648818 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.648735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44939 (local address 127.29.168.194:38591)
0808 14:40:48.648776 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.648796 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:40:48.651248 7603 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:48.651347 7603 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:48.652611 7603 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40f1f05fdb21478387d8bfa30b6176f7: Sending DeleteTablet for 3 replicas of tablet cf04c7a360234184a8ae5a12d6299e10
I20260808 14:40:48.652877 8511 tablet_service.cc:1514] Processing DeleteTablet for tablet cf04c7a360234184a8ae5a12d6299e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:48 UTC) from {username='oryx', principal='oryx/127.29.168.253@KRBTEST.COM'} at 127.0.0.1:60198
I20260808 14:40:48.652921 8276 tablet_service.cc:1514] Processing DeleteTablet for tablet cf04c7a360234184a8ae5a12d6299e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:48 UTC) from {username='oryx', principal='oryx/127.29.168.253@KRBTEST.COM'} at 127.0.0.1:57118
I20260808 14:40:48.652923 8069 tablet_service.cc:1514] Processing DeleteTablet for tablet cf04c7a360234184a8ae5a12d6299e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:48 UTC) from {username='oryx', principal='oryx/127.29.168.253@KRBTEST.COM'} at 127.0.0.1:33534
I20260808 14:40:48.653256 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 7836
I20260808 14:40:48.659760 8799 tablet_replica.cc:330] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: stopping tablet replica
I20260808 14:40:48.659821 8799 raft_consensus.cc:2229] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:48.659861 8799 raft_consensus.cc:2258] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:48.659981 8800 tablet_replica.cc:330] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: stopping tablet replica
I20260808 14:40:48.660027 8800 raft_consensus.cc:2229] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:48.660099 8800 raft_consensus.cc:2258] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:48.660862 8800 ts_tablet_manager.cc:1905] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:48.661363 8799 ts_tablet_manager.cc:1905] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:48.662474 8800 ts_tablet_manager.cc:1918] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:48.662531 8800 log.cc:1196] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/cf04c7a360234184a8ae5a12d6299e10
I20260808 14:40:48.662761 8800 ts_tablet_manager.cc:1939] T cf04c7a360234184a8ae5a12d6299e10 P 6cae014b9a124685b31d33c70e94e170: Deleting consensus metadata
I20260808 14:40:48.663043 7576 catalog_manager.cc:4841] TS 6cae014b9a124685b31d33c70e94e170 (127.29.168.194:43695): tablet cf04c7a360234184a8ae5a12d6299e10 (table test-table [id=0d6c8da88d1e4984a2610d0abff2524e]) successfully deleted
I20260808 14:40:48.663457 8799 ts_tablet_manager.cc:1918] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:48.663509 8799 log.cc:1196] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/cf04c7a360234184a8ae5a12d6299e10
I20260808 14:40:48.663800 8799 ts_tablet_manager.cc:1939] T cf04c7a360234184a8ae5a12d6299e10 P 7fcfdc8956824afa9cb59d0fb697f6bf: Deleting consensus metadata
I20260808 14:40:48.664101 7577 catalog_manager.cc:4841] TS 7fcfdc8956824afa9cb59d0fb697f6bf (127.29.168.195:45089): tablet cf04c7a360234184a8ae5a12d6299e10 (table test-table [id=0d6c8da88d1e4984a2610d0abff2524e]) successfully deleted
I20260808 14:40:48.668584 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:48.668465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:42173 (local address 127.0.0.1:33544)
0808 14:40:48.668526 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:48.668554 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:42173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:40:48.668699 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 8181
W20260808 14:40:48.668756 7575 catalog_manager.cc:4584] TS 18527c8589eb47a5907b96c58659e3fe (127.29.168.193:42173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf04c7a360234184a8ae5a12d6299e10: Network error: Client connection negotiation failed: client connection to 127.29.168.193:42173: connect: Connection refused (error 111)
I20260808 14:40:48.677173 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 8406
I20260808 14:40:48.684051 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 7385
I20260808 14:40:48.695353 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 7680
2026-08-08T14:40:48Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4652 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:48 dist-test-slave-mjjr krb5kdc[8805](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:48 dist-test-slave-mjjr krb5kdc[8805](info): set up 2 sockets
Aug 08 14:40:48 dist-test-slave-mjjr krb5kdc[8805](info): commencing operation
krb5kdc: starting...
W20260808 14:40:50.019871 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:50Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab.
Entry for principal oryx/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab.
I20260808 14:40:50.128397 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45235
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab
--principal=oryx/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:45235
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:50.205149 8827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:50.205368 8827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:50.205391 8827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:50.206545 8827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:50.206586 8827 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:40:50.206599 8827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:50.206612 8827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:50.206666 8827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:50.206683 8827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:50.208154 8827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:45235
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.254.keytab
--principal=oryx/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:50.208360 8827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:50.208593 8827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:50.213244 8839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:50.213265 8836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:50.213253 8837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:50.213524 8827 server_base.cc:1034] running on GCE node
I20260808 14:40:50.213759 8827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:50.214076 8827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:50.215230 8827 hybrid_clock.cc:648] HybridClock initialized: now 1786200050215227 us; error 37 us; skew 500 ppm
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:50.217552 8827 init.cc:377] Logged in from keytab as oryx/127.29.168.254@KRBTEST.COM (short username oryx)
I20260808 14:40:50.217947 8827 webserver.cc:460] Webserver started at http://127.29.168.254:45923/ using document root <none> and password file <none>
I20260808 14:40:50.218168 8827 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:50.218236 8827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:50.218410 8827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:50.219409 8827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "79fb37b9d1d6449f8ca790a2a1e41681"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "08eb68a5ed6e685c5fd8852c86a05542"
server_key_iv: "7da5f746bbb34cd40b0afe98e0264877"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.219833 8827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "79fb37b9d1d6449f8ca790a2a1e41681"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "08eb68a5ed6e685c5fd8852c86a05542"
server_key_iv: "7da5f746bbb34cd40b0afe98e0264877"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.221102 8827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:50.221872 8848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.222047 8827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:50.222158 8827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "79fb37b9d1d6449f8ca790a2a1e41681"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "08eb68a5ed6e685c5fd8852c86a05542"
server_key_iv: "7da5f746bbb34cd40b0afe98e0264877"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.222235 8827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:50.235394 8827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:50.237512 8827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:50.237663 8827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:50.242326 8827 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:45235
I20260808 14:40:50.242376 8946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:45235 every 8 connection(s)
I20260808 14:40:50.242683 8827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:50.243036 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 8827
I20260808 14:40:50.243153 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:50.243359 30371 external_mini_cluster.cc:1428] Setting key 22c1428fc744427675f2af06ac8a7f68
I20260808 14:40:50.243542 8947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:50.246317 8947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Bootstrap starting.
I20260808 14:40:50.247112 8947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:50.247421 8947 log.cc:824] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:50.248194 8947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: No bootstrap required, opened a new log
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:50.249998 8947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45235 } }
I20260808 14:40:50.250169 8947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:50.250218 8947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79fb37b9d1d6449f8ca790a2a1e41681, State: Initialized, Role: FOLLOWER
I20260808 14:40:50.250347 8947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45235 } }
I20260808 14:40:50.250451 8947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:50.250500 8947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:50.250561 8947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:50.251333 8947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45235 } }
I20260808 14:40:50.251464 8947 leader_election.cc:302] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79fb37b9d1d6449f8ca790a2a1e41681; no voters:
I20260808 14:40:50.251624 8947 leader_election.cc:288] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:50.251695 8955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:50.251895 8955 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [term 1 LEADER]: Becoming Leader. State: Replica: 79fb37b9d1d6449f8ca790a2a1e41681, State: Running, Role: LEADER
I20260808 14:40:50.251916 8947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:50.251995 8955 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45235 } }
I20260808 14:40:50.252300 8957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45235 } } }
I20260808 14:40:50.252394 8957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:50.252538 8958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79fb37b9d1d6449f8ca790a2a1e41681. Latest consensus state: current_term: 1 leader_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fb37b9d1d6449f8ca790a2a1e41681" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45235 } } }
I20260808 14:40:50.252614 8958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:50.252728 8961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:50.253305 8961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:50.254083 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.243890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.29.168.254:45235)
0808 14:40:50.244057 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.244066 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.244101 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:40:50.244735 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.244742 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.244790 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.244937 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.245557 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.246433 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.247577 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.248123 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.248228 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.250432 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.250436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.250436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.250448 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.252334 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.252804 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.252807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.252808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.252906 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.253137 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.253138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.253138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.253570 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.253687 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.253855 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.253949 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
I20260808 14:40:50.255229 8961 catalog_manager.cc:1347] Generated new cluster ID: 05755acc30c7430494ebe9f2fd44302b
I20260808 14:40:50.255288 8961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:50.275883 8961 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:50.276527 8961 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:50.281188 8961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Generated new TSK 0
I20260808 14:40:50.281349 8961 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab.
Entry for principal oryx/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab.
I20260808 14:40:50.306463 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45235
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:50.383903 8985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:50.384094 8985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:50.384119 8985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:50.385193 8985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:50.385226 8985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:50.385244 8985 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:50.385262 8985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:50.386664 8985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:50.386847 8985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:50.387012 8985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:50.391642 8993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:50.391642 8990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:50.391714 8985 server_base.cc:1034] running on GCE node
W20260808 14:40:50.391731 8991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:50.392019 8985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:50.392242 8985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:50.393395 8985 hybrid_clock.cc:648] HybridClock initialized: now 1786200050393381 us; error 25 us; skew 500 ppm
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:50.395920 8985 init.cc:377] Logged in from keytab as oryx/127.29.168.193@KRBTEST.COM (short username oryx)
I20260808 14:40:50.396379 8985 webserver.cc:460] Webserver started at http://127.29.168.193:43307/ using document root <none> and password file <none>
I20260808 14:40:50.396602 8985 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:50.396668 8985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:50.396821 8985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:50.397751 8985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "9c85de72056e4ed298c151bf91d55592"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "e8fd79df68e3f2279c325a5d1fb10b47"
server_key_iv: "72406005752d23cd4f10643f748b03ea"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.398135 8985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "9c85de72056e4ed298c151bf91d55592"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "e8fd79df68e3f2279c325a5d1fb10b47"
server_key_iv: "72406005752d23cd4f10643f748b03ea"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.399412 8985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:50.400220 9005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.400446 8985 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:50.400552 8985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "9c85de72056e4ed298c151bf91d55592"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "e8fd79df68e3f2279c325a5d1fb10b47"
server_key_iv: "72406005752d23cd4f10643f748b03ea"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.400633 8985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:50.431141 8985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:50.432967 8985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:50.433127 8985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:50.433614 8985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:50.433681 8985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.433725 8985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:50.433784 8985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:50.440999 8985 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38227
I20260808 14:40:50.441090 9188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38227 every 8 connection(s)
I20260808 14:40:50.441408 8985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:50.443547 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.434253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:40687 (local address 127.29.168.254:45235)
0808 14:40:50.434334 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.434338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.434498 (+ 160us) server_negotiation.cc:407] Connection header received
0808 14:40:50.434982 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.434983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.434997 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.435070 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.435964 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.436522 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.437587 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.437800 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.437892 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.440801 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.440803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.440803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.440812 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.442437 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.442824 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.442826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.442826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.442879 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.443091 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.443092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.443092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.443187 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.443234 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.443414 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.443487 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:40:50.443643 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.434175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.29.168.193:40687)
0808 14:40:50.434363 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.434402 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.434881 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.435176 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.435180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.435564 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:50.435853 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.435859 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.436635 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.436636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.437477 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.437480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.437907 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.437908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.438035 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.438575 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:50.438583 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:50.440661 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:50.442507 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.442510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.442512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.442700 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.442949 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.442950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.442950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.443038 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.443225 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:50.443227 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:50.443320 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.443386 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.443487 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":97,"threads_started":1}
I20260808 14:40:50.444172 9189 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45235
I20260808 14:40:50.444259 9189 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:50.444432 9189 heartbeater.cc:511] Master 127.29.168.254:45235 requested a full tablet report, sending...
I20260808 14:40:50.444924 8875 ts_manager.cc:194] Registered new tserver with Master: 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227)
I20260808 14:40:50.445765 8875 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:40687
I20260808 14:40:50.449923 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.445222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:35003 (local address 127.29.168.254:45235)
0808 14:40:50.445269 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.445271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.445389 (+ 118us) server_negotiation.cc:407] Connection header received
0808 14:40:50.445412 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.445413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.445423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.445485 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.445720 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.446321 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.447058 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.447227 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.447275 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.448163 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.448164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.448164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.448169 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.449173 (+ 1004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.449455 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.449456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.449456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.449501 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.449611 (+ 110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.449612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.449612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.449687 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.449728 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.449821 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.449873 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:40:50.449929 9197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.445165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.29.168.193:35003)
0808 14:40:50.445314 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.445323 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.445380 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.445487 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.445488 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.445617 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:50.445664 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.445666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.446419 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.446420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.446983 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.446985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.447285 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.447286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.447339 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.447811 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:50.447816 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:50.448097 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:50.449240 (+ 1143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.449240 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.449241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.449395 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.449540 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.449541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.449541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.449580 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.449719 (+ 139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:50.449719 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:50.449764 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.449807 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.449870 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260808 14:40:50.451066 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 8985
I20260808 14:40:50.451193 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:50.451406 30371 external_mini_cluster.cc:1428] Setting key c2d753f542c9d80db6187077359b216d
WARNING: no policy specified for oryx/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab.
Entry for principal oryx/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab.
I20260808 14:40:50.476131 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45235
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:50.554481 9202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:50.554666 9202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:50.554689 9202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:50.555781 9202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:50.555815 9202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:50.555833 9202 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:50.555848 9202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:50.557142 9202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:50.557308 9202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:50.557458 9202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:50.561941 9218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:50.562001 9213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:50.562134 9202 server_base.cc:1034] running on GCE node
W20260808 14:40:50.562008 9214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:50.562427 9202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:50.562678 9202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:50.563812 9202 hybrid_clock.cc:648] HybridClock initialized: now 1786200050563801 us; error 29 us; skew 500 ppm
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:50.566219 9202 init.cc:377] Logged in from keytab as oryx/127.29.168.194@KRBTEST.COM (short username oryx)
I20260808 14:40:50.566680 9202 webserver.cc:460] Webserver started at http://127.29.168.194:33757/ using document root <none> and password file <none>
I20260808 14:40:50.566912 9202 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:50.566980 9202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:50.567129 9202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:50.568157 9202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "fcbdb2ef87d14a86946220d251a70535"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "34adf1de615a144efbe91cc7430f2e5d"
server_key_iv: "cc855efa5718a1575575d9ebe4b50a53"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.568483 9202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "fcbdb2ef87d14a86946220d251a70535"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "34adf1de615a144efbe91cc7430f2e5d"
server_key_iv: "cc855efa5718a1575575d9ebe4b50a53"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.569684 9202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:40:50.570417 9227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.570607 9202 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:50.570703 9202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "fcbdb2ef87d14a86946220d251a70535"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "34adf1de615a144efbe91cc7430f2e5d"
server_key_iv: "cc855efa5718a1575575d9ebe4b50a53"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.570775 9202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:50.589488 9202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:50.591579 9202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:50.591784 9202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:50.592262 9202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:50.592315 9202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.592351 9202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:50.592373 9202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:50.599206 9202 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:35351
I20260808 14:40:50.599581 9202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:50.599673 9426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:35351 every 8 connection(s)
I20260808 14:40:50.600476 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 9202
I20260808 14:40:50.600592 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:50.600805 30371 external_mini_cluster.cc:1428] Setting key 1e87dbf44b703e64d1c336ed69250477
I20260808 14:40:50.601960 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.592585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:45679 (local address 127.29.168.254:45235)
0808 14:40:50.592652 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.592655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.592859 (+ 204us) server_negotiation.cc:407] Connection header received
0808 14:40:50.593292 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.593293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.593305 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.593369 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.594010 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.594837 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.596370 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.596577 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.596653 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.598723 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.598724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.598724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.598732 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.600421 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.600870 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.600872 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.600873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.600936 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.601271 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.601272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.601273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.601416 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.601490 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.601829 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.601897 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:50.602169 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.592580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.29.168.194:45679)
0808 14:40:50.592741 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.592775 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.593171 (+ 396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.593428 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.593433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.593724 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:50.593910 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.593914 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.594940 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.594941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.596282 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.596285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.596685 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.596686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.596830 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.597280 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:50.597287 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:50.598608 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:50.600522 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.600530 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.600533 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.600778 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.601024 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.601025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.601025 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.601171 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.601489 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:50.601495 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:50.601629 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.601766 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.601929 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":98,"threads_started":1}
I20260808 14:40:50.603782 9428 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45235
I20260808 14:40:50.603884 9428 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:50.604055 9428 heartbeater.cc:511] Master 127.29.168.254:45235 requested a full tablet report, sending...
I20260808 14:40:50.604452 8876 ts_manager.cc:194] Registered new tserver with Master: fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:50.604957 8876 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:45679
WARNING: no policy specified for oryx/127.29.168.195@KRBTEST.COM; defaulting to no policy
I20260808 14:40:50.610275 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.604953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:56147 (local address 127.29.168.254:45235)
0808 14:40:50.605006 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.605008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.605016 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:50.605082 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.605095 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.605105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.605154 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.605488 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.606099 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.606794 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.606996 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.607067 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.608006 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.608007 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.608008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.608014 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.609200 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.609514 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.609515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.609515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.609563 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.609757 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.609758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.609758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.609886 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.609995 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.610140 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.610202 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:40:50.610296 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.604829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.29.168.194:56147)
0808 14:40:50.604948 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.604958 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.605025 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.605158 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.605158 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.605321 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:50.605399 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.605401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.606196 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.606197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.606707 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.606708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.607080 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.607081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.607144 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.607576 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:50.607581 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:50.607910 (+ 329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:50.609283 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.609284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.609285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.609445 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.609641 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.609641 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.609642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.609692 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.609973 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:50.609991 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:50.610031 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.610118 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.610203 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab.
Entry for principal oryx/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab.
I20260808 14:40:50.623984 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45235
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:50.700870 9441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:50.701081 9441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:50.701117 9441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:50.702147 9441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:50.702214 9441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:50.702243 9441 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:40:50.702277 9441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:50.703883 9441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.168.254:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:50.704123 9441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:50.704329 9441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:40:50.709144 9441 server_base.cc:1034] running on GCE node
W20260808 14:40:50.709156 9450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:50.709158 9447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:50.709297 9456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:50.709537 9441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:50.709707 9441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:50.710872 9441 hybrid_clock.cc:648] HybridClock initialized: now 1786200050710859 us; error 23 us; skew 500 ppm
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:50.713193 9441 init.cc:377] Logged in from keytab as oryx/127.29.168.195@KRBTEST.COM (short username oryx)
I20260808 14:40:50.713584 9441 webserver.cc:460] Webserver started at http://127.29.168.195:39509/ using document root <none> and password file <none>
I20260808 14:40:50.713810 9441 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:50.713881 9441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:50.713966 9441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:50.714879 9441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "b3d718089ad34adbb31f4ebade8c7f37"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "948f00124c657a1576d574e5b258df31"
server_key_iv: "8bf3d50294000381b3376f3bdeb02a93"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.715174 9441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "b3d718089ad34adbb31f4ebade8c7f37"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "948f00124c657a1576d574e5b258df31"
server_key_iv: "8bf3d50294000381b3376f3bdeb02a93"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.716632 9441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:40:50.717293 9466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.717476 9441 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:50.717545 9441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "b3d718089ad34adbb31f4ebade8c7f37"
format_stamp: "Formatted at 2026-08-08 14:40:50 on dist-test-slave-mjjr"
server_key: "948f00124c657a1576d574e5b258df31"
server_key_iv: "8bf3d50294000381b3376f3bdeb02a93"
server_key_version: "encryptionkey@0"
I20260808 14:40:50.717592 9441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:50.734257 9441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:50.735942 9441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:50.736044 9441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:50.736443 9441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:50.736477 9441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:50.736527 9441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:50.736557 9441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:50.743907 9441 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:41601
I20260808 14:40:50.743989 9635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:41601 every 8 connection(s)
I20260808 14:40:50.744385 9441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:50.747023 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.736960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:33109 (local address 127.29.168.254:45235)
0808 14:40:50.737035 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.737037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.737182 (+ 145us) server_negotiation.cc:407] Connection header received
0808 14:40:50.737588 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.737590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.737603 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.737686 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.738514 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.739320 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.741111 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.741468 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.741532 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.744205 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.744206 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.744207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.744214 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.745910 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.746279 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.746280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.746280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.746331 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.746520 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.746521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.746521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.746617 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.746667 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.746898 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.746961 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:40:50.747188 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.736881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.29.168.195:33109)
0808 14:40:50.737054 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.737092 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.737502 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.737728 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.737730 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.738136 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:50.738393 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.738399 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.739423 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.739424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.740872 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.740875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.741606 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.741607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.741744 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.742259 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:50.742269 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:50.744109 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:50.745985 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.745991 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.745993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.746205 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.746373 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.746373 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.746374 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.746453 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.746674 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:50.746679 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:50.746788 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.746867 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.746979 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":92,"threads_started":1}
I20260808 14:40:50.747705 9637 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45235
I20260808 14:40:50.747786 9637 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:50.747953 9637 heartbeater.cc:511] Master 127.29.168.254:45235 requested a full tablet report, sending...
I20260808 14:40:50.748338 8876 ts_manager.cc:194] Registered new tserver with Master: b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601)
I20260808 14:40:50.748404 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 9441
I20260808 14:40:50.748534 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:50.748769 30371 external_mini_cluster.cc:1428] Setting key bea52a38664f503f5cff5ecf9872f51b
I20260808 14:40:50.748790 8876 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:33109
I20260808 14:40:50.749684 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:40:50.755713 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.748965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:57967 (local address 127.29.168.254:45235)
0808 14:40:50.749641 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.749643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.749651 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:50.749669 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.749669 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.749678 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.749735 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.750068 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.750466 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.751505 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.751712 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.751773 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.752922 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.752923 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.752924 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.752930 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.754492 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.754872 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.754873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.754873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.754929 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.755143 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.755144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.755144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.755257 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.755338 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.755527 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.755593 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657}
I20260808 14:40:50.755734 9646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.748768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.29.168.195:57967)
0808 14:40:50.748953 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.748963 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.749012 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.749753 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.749754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.749933 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:50.749998 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.750000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.750583 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.750584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.751373 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.751376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.751812 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.751813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.751881 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.752339 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:50.752406 (+ 67us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:50.752800 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:50.754598 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.754599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.754600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.754793 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.755010 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:50.755011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:50.755011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:50.755070 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:50.755342 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:50.755343 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:50.755398 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.755489 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.755591 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":84,"threads_started":1}
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:40:50.771107 8951 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:50.766349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59656 (local address 127.29.168.254:45235)
0808 14:40:50.766387 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.766388 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.766398 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:40:50.766443 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.766443 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.766451 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.766507 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.767052 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.767489 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.768214 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.768370 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.768418 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.771035 (+ 2617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59656: BlockingRecv error: recv got EOF from 127.0.0.1:59656 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 08 14:40:50 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:50.777905 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.771805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59672 (local address 127.29.168.254:45235)
0808 14:40:50.771859 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.771860 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.771911 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:40:50.771973 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.771974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.771981 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.772027 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:50.772417 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.772870 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.773572 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.773755 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.773826 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.775759 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:50.775760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:50.775761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:50.775767 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:50.776809 (+ 1042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.777147 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.777148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.777148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.777201 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:50.777412 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:50.777413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:50.777413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:50.777513 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:50.777608 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.777725 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.777811 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:40:50.779276 8876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:50.780936 8876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:50.786938 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.783207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.29.168.195:41601)
0808 14:40:50.783381 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.783386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.783497 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:40:50.783543 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.783545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.783557 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.783625 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:50.783832 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.784889 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.785992 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.786483 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.786619 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.786677 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.786802 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.786838 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":85,"threads_started":1}
I20260808 14:40:50.786988 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.783095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38227 (local address 127.0.0.1:41878)
0808 14:40:50.783238 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.783289 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.783354 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.783601 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.783604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.783607 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:50.783679 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.783681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.784686 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.784688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.785820 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.785822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.786683 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.786684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.786764 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.786768 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.786799 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.786849 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":52,"threads_started":1}
I20260808 14:40:50.786942 9669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.783134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:41601 (local address 127.0.0.1:51922)
0808 14:40:50.783437 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.783446 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.783494 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.783715 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.783715 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.783717 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:50.783756 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.783757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.784989 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.784990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.785915 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.785917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.786598 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.786603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.786690 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.786704 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.786774 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.786830 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":47,"threads_started":1}
I20260808 14:40:50.787220 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.783206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41878 (local address 127.29.168.193:38227)
0808 14:40:50.783384 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.783389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.783401 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:40:50.783440 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.783442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.783456 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.783531 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:50.783743 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.784602 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.785897 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.786553 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.787003 (+ 450us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.787066 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.787090 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.787125 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":69,"threads_started":1}
I20260808 14:40:50.787302 9674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.783287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:35351 (local address 127.0.0.1:39372)
0808 14:40:50.783792 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.783802 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.783850 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.784056 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.784056 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.784059 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:50.784104 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.784105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.785217 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.785218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.785929 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.785932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.786846 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.786846 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.786901 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.786904 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.786951 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.786987 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":20,"thread_start_us":63,"threads_started":1}
I20260808 14:40:50.787552 9677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.783491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39372 (local address 127.29.168.194:35351)
0808 14:40:50.783682 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.783685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.783924 (+ 239us) server_negotiation.cc:407] Connection header received
0808 14:40:50.783967 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.783969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.783984 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.784056 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:50.784180 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.785150 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.786013 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.786684 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.786759 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.786814 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.787031 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.787443 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260808 14:40:50.787981 9082 tablet_service.cc:1467] Processing CreateTablet for tablet a92fa2120ffe4540b3d3406f763af516 (DEFAULT_TABLE table=test-table [id=754ded4a0b1747598e1b364057608009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:50.787999 9531 tablet_service.cc:1467] Processing CreateTablet for tablet a92fa2120ffe4540b3d3406f763af516 (DEFAULT_TABLE table=test-table [id=754ded4a0b1747598e1b364057608009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:50.788385 9082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a92fa2120ffe4540b3d3406f763af516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:50.788385 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a92fa2120ffe4540b3d3406f763af516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:50.788436 9315 tablet_service.cc:1467] Processing CreateTablet for tablet a92fa2120ffe4540b3d3406f763af516 (DEFAULT_TABLE table=test-table [id=754ded4a0b1747598e1b364057608009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:50.788719 9315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a92fa2120ffe4540b3d3406f763af516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:50.791235 9678 tablet_bootstrap.cc:492] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Bootstrap starting.
I20260808 14:40:50.791966 9678 tablet_bootstrap.cc:654] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:50.792348 9678 log.cc:824] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:50.792563 9680 tablet_bootstrap.cc:492] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Bootstrap starting.
I20260808 14:40:50.793113 9678 tablet_bootstrap.cc:492] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: No bootstrap required, opened a new log
I20260808 14:40:50.793164 9680 tablet_bootstrap.cc:654] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:50.793187 9678 ts_tablet_manager.cc:1397] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:50.793453 9680 log.cc:824] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:50.792380 9679 tablet_bootstrap.cc:492] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Bootstrap starting.
I20260808 14:40:50.794226 9680 tablet_bootstrap.cc:492] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: No bootstrap required, opened a new log
I20260808 14:40:50.794308 9680 ts_tablet_manager.cc:1397] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:50.794428 9679 tablet_bootstrap.cc:654] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:50.794727 9679 log.cc:824] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:50.795380 9678 raft_consensus.cc:348] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.795545 9679 tablet_bootstrap.cc:492] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: No bootstrap required, opened a new log
I20260808 14:40:50.795562 9678 raft_consensus.cc:374] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:50.795599 9679 ts_tablet_manager.cc:1397] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:40:50.795598 9678 raft_consensus.cc:729] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c85de72056e4ed298c151bf91d55592, State: Initialized, Role: FOLLOWER
I20260808 14:40:50.795794 9678 consensus_queue.cc:260] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.796063 9678 ts_tablet_manager.cc:1428] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:40:50.796192 9189 heartbeater.cc:503] Master 127.29.168.254:45235 was elected leader, sending a full tablet report...
I20260808 14:40:50.796267 9680 raft_consensus.cc:348] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.796420 9680 raft_consensus.cc:374] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:50.796460 9680 raft_consensus.cc:729] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbdb2ef87d14a86946220d251a70535, State: Initialized, Role: FOLLOWER
I20260808 14:40:50.796573 9680 consensus_queue.cc:260] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.796842 9680 ts_tablet_manager.cc:1428] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:40:50.796885 9428 heartbeater.cc:503] Master 127.29.168.254:45235 was elected leader, sending a full tablet report...
I20260808 14:40:50.797984 9679 raft_consensus.cc:348] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.798112 9679 raft_consensus.cc:374] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:50.798131 9679 raft_consensus.cc:729] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Initialized, Role: FOLLOWER
I20260808 14:40:50.798218 9679 consensus_queue.cc:260] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.798409 9679 ts_tablet_manager.cc:1428] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:40:50.798462 9637 heartbeater.cc:503] Master 127.29.168.254:45235 was elected leader, sending a full tablet report...
W20260808 14:40:50.850320 9429 tablet.cc:2369] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:40:50.942517 9190 tablet.cc:2369] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:50.964087 9687 raft_consensus.cc:482] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:50.964200 9687 raft_consensus.cc:504] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.964550 9687 leader_election.cc:288] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601)
I20260808 14:40:50.968099 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.964762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:40795 (local address 127.29.168.193:38227)
0808 14:40:50.964808 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.964811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.964862 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:40:50.964952 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.964953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.964964 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.965024 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:50.965201 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.965731 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.967160 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.967767 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.967834 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.967844 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.968018 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.968050 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:40:50.968174 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.964741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38227 (local address 127.29.168.194:40795)
0808 14:40:50.964803 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.964815 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.964879 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.965040 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.965041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.965043 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:50.965130 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.965132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.965837 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.965838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.967060 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.967063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.967854 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.967855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.967949 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.967953 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.968004 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.968051 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":8}
I20260808 14:40:50.968547 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.964852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:55871 (local address 127.29.168.195:41601)
0808 14:40:50.964907 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:50.964909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:50.965026 (+ 117us) server_negotiation.cc:407] Connection header received
0808 14:40:50.965058 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:50.965059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:50.965080 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:50.965147 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:50.965317 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.965738 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.967160 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.967767 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.967847 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.967855 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:50.968466 (+ 611us) server_negotiation.cc:299] Negotiation successful
0808 14:40:50.968503 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:40:50.968572 9690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:50.964749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:41601 (local address 127.29.168.194:55871)
0808 14:40:50.964925 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:50.964936 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:50.965003 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:50.965157 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:50.965157 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:50.965159 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:50.965246 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.965247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.965875 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.965875 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.967060 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:50.967063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:50.967854 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:50.967855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:50.968322 (+ 467us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:50.968326 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:50.968436 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:40:50.968479 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":16,"thread_start_us":113,"threads_started":1}
I20260808 14:40:50.968537 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a92fa2120ffe4540b3d3406f763af516" candidate_uuid: "fcbdb2ef87d14a86946220d251a70535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592" is_pre_election: true
I20260808 14:40:50.968693 9111 raft_consensus.cc:2454] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcbdb2ef87d14a86946220d251a70535 in term 0.
I20260808 14:40:50.968900 9564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a92fa2120ffe4540b3d3406f763af516" candidate_uuid: "fcbdb2ef87d14a86946220d251a70535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d718089ad34adbb31f4ebade8c7f37" is_pre_election: true
I20260808 14:40:50.968932 9231 leader_election.cc:302] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, fcbdb2ef87d14a86946220d251a70535; no voters:
I20260808 14:40:50.969062 9564 raft_consensus.cc:2454] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcbdb2ef87d14a86946220d251a70535 in term 0.
I20260808 14:40:50.969071 9687 raft_consensus.cc:2781] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:50.969131 9687 raft_consensus.cc:482] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:50.969168 9687 raft_consensus.cc:3037] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:50.969909 9687 raft_consensus.cc:504] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.970080 9687 leader_election.cc:288] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [CANDIDATE]: Term 1 election: Requested vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601)
I20260808 14:40:50.970221 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a92fa2120ffe4540b3d3406f763af516" candidate_uuid: "fcbdb2ef87d14a86946220d251a70535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592"
I20260808 14:40:50.970221 9564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a92fa2120ffe4540b3d3406f763af516" candidate_uuid: "fcbdb2ef87d14a86946220d251a70535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d718089ad34adbb31f4ebade8c7f37"
I20260808 14:40:50.970309 9111 raft_consensus.cc:3037] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:50.970304 9564 raft_consensus.cc:3037] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:50.971012 9111 raft_consensus.cc:2454] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcbdb2ef87d14a86946220d251a70535 in term 1.
I20260808 14:40:50.971050 9564 raft_consensus.cc:2454] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcbdb2ef87d14a86946220d251a70535 in term 1.
I20260808 14:40:50.971220 9231 leader_election.cc:302] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, fcbdb2ef87d14a86946220d251a70535; no voters:
I20260808 14:40:50.971314 9687 raft_consensus.cc:2781] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:50.971462 9687 raft_consensus.cc:686] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 1 LEADER]: Becoming Leader. State: Replica: fcbdb2ef87d14a86946220d251a70535, State: Running, Role: LEADER
I20260808 14:40:50.971566 9687 consensus_queue.cc:237] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:50.972399 8875 catalog_manager.cc:5495] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcbdb2ef87d14a86946220d251a70535 (127.29.168.194). New cstate: current_term: 1 leader_uuid: "fcbdb2ef87d14a86946220d251a70535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
W20260808 14:40:50.995369 9639 tablet.cc:2369] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:40:51.015483 9677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.013015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39380 (local address 127.29.168.194:35351)
0808 14:40:51.013078 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.013080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.013089 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:51.013145 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.013146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.013162 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.013229 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:51.013409 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.013858 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.014654 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.014851 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.014937 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.015145 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.015240 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.015334 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.015349 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.015378 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:40:51.017189 9111 raft_consensus.cc:1261] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Refusing update from remote peer fcbdb2ef87d14a86946220d251a70535: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.017203 9564 raft_consensus.cc:1261] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Refusing update from remote peer fcbdb2ef87d14a86946220d251a70535: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.017541 9687 consensus_queue.cc:1035] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.017679 9691 consensus_queue.cc:1035] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.022069 8875 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.022145 8875 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.023020 8875 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Sending DeleteTablet for 3 replicas of tablet a92fa2120ffe4540b3d3406f763af516
I20260808 14:40:51.023365 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet a92fa2120ffe4540b3d3406f763af516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51922
I20260808 14:40:51.023370 9082 tablet_service.cc:1514] Processing DeleteTablet for tablet a92fa2120ffe4540b3d3406f763af516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41878
I20260808 14:40:51.023445 9315 tablet_service.cc:1514] Processing DeleteTablet for tablet a92fa2120ffe4540b3d3406f763af516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39372
I20260808 14:40:51.023723 9713 tablet_replica.cc:330] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: stopping tablet replica
I20260808 14:40:51.023725 8875 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:40:51.023829 9713 raft_consensus.cc:2229] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 14:40:51.023869 8875 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:51.023923 9713 raft_consensus.cc:2258] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.024075 9718 tablet_replica.cc:330] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: stopping tablet replica
I20260808 14:40:51.024158 9718 raft_consensus.cc:2229] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.024885 9713 ts_tablet_manager.cc:1905] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.025204 9531 tablet_service.cc:1467] Processing CreateTablet for tablet bf8b77c7a38f4391bb558dbdfb64fd52 (DEFAULT_TABLE table=test-table [id=58c9048518344416a7f8bb4f1feb8974]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.025326 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf8b77c7a38f4391bb558dbdfb64fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.026602 9718 raft_consensus.cc:2258] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.026751 9679 tablet_bootstrap.cc:492] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Bootstrap starting.
I20260808 14:40:51.026787 9713 ts_tablet_manager.cc:1918] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:51.026856 9713 log.cc:1196] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/a92fa2120ffe4540b3d3406f763af516
I20260808 14:40:51.027084 9082 tablet_service.cc:1467] Processing CreateTablet for tablet bf8b77c7a38f4391bb558dbdfb64fd52 (DEFAULT_TABLE table=test-table [id=58c9048518344416a7f8bb4f1feb8974]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.027137 9718 ts_tablet_manager.cc:1905] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.027192 9082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf8b77c7a38f4391bb558dbdfb64fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.027240 9679 tablet_bootstrap.cc:654] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.027318 9315 tablet_service.cc:1467] Processing CreateTablet for tablet bf8b77c7a38f4391bb558dbdfb64fd52 (DEFAULT_TABLE table=test-table [id=58c9048518344416a7f8bb4f1feb8974]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.027418 9315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf8b77c7a38f4391bb558dbdfb64fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.028600 9718 ts_tablet_manager.cc:1918] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:51.028704 9678 tablet_bootstrap.cc:492] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Bootstrap starting.
I20260808 14:40:51.028723 9718 log.cc:1196] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/a92fa2120ffe4540b3d3406f763af516
I20260808 14:40:51.028815 9680 tablet_bootstrap.cc:492] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Bootstrap starting.
I20260808 14:40:51.029083 9678 tablet_bootstrap.cc:654] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.029230 9680 tablet_bootstrap.cc:654] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.029433 9679 tablet_bootstrap.cc:492] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: No bootstrap required, opened a new log
I20260808 14:40:51.029471 9679 ts_tablet_manager.cc:1397] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 14:40:51.027179 9713 ts_tablet_manager.cc:1939] T a92fa2120ffe4540b3d3406f763af516 P 9c85de72056e4ed298c151bf91d55592: Deleting consensus metadata
I20260808 14:40:51.029629 9679 raft_consensus.cc:348] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.029696 9679 raft_consensus.cc:374] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.029719 9679 raft_consensus.cc:729] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.029748 9718 ts_tablet_manager.cc:1939] T a92fa2120ffe4540b3d3406f763af516 P b3d718089ad34adbb31f4ebade8c7f37: Deleting consensus metadata
I20260808 14:40:51.029757 9679 consensus_queue.cc:260] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.029860 9679 ts_tablet_manager.cc:1428] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.030018 8852 catalog_manager.cc:4841] TS 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227): tablet a92fa2120ffe4540b3d3406f763af516 (table test-table [id=754ded4a0b1747598e1b364057608009]) successfully deleted
I20260808 14:40:51.030076 8849 catalog_manager.cc:4841] TS b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601): tablet a92fa2120ffe4540b3d3406f763af516 (table test-table [id=754ded4a0b1747598e1b364057608009]) successfully deleted
I20260808 14:40:51.030402 9678 tablet_bootstrap.cc:492] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: No bootstrap required, opened a new log
I20260808 14:40:51.030417 9680 tablet_bootstrap.cc:492] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: No bootstrap required, opened a new log
I20260808 14:40:51.030453 9680 ts_tablet_manager.cc:1397] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:51.030454 9678 ts_tablet_manager.cc:1397] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:51.030582 9678 raft_consensus.cc:348] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.030582 9680 raft_consensus.cc:348] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.030643 9678 raft_consensus.cc:374] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.030643 9680 raft_consensus.cc:374] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.030663 9680 raft_consensus.cc:729] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbdb2ef87d14a86946220d251a70535, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.030663 9678 raft_consensus.cc:729] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c85de72056e4ed298c151bf91d55592, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.030715 9680 consensus_queue.cc:260] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.030716 9678 consensus_queue.cc:260] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.030800 9680 ts_tablet_manager.cc:1428] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.030817 9678 ts_tablet_manager.cc:1428] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.031728 9722 tablet_replica.cc:330] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: stopping tablet replica
I20260808 14:40:51.031840 9722 raft_consensus.cc:2229] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:51.031976 9722 raft_consensus.cc:2258] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.032269 9689 raft_consensus.cc:482] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:51.032358 9722 ts_tablet_manager.cc:1905] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.032334 9689 raft_consensus.cc:504] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.032590 9689 leader_election.cc:288] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.034053 9722 ts_tablet_manager.cc:1918] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:51.034183 9722 log.cc:1196] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/a92fa2120ffe4540b3d3406f763af516
I20260808 14:40:51.034745 9722 ts_tablet_manager.cc:1939] T a92fa2120ffe4540b3d3406f763af516 P fcbdb2ef87d14a86946220d251a70535: Deleting consensus metadata
I20260808 14:40:51.035171 8852 catalog_manager.cc:4841] TS fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351): tablet a92fa2120ffe4540b3d3406f763af516 (table test-table [id=754ded4a0b1747598e1b364057608009]) successfully deleted
I20260808 14:40:51.036528 9677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.032920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:53727 (local address 127.29.168.194:35351)
0808 14:40:51.032954 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.032956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.033060 (+ 104us) server_negotiation.cc:407] Connection header received
0808 14:40:51.033155 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.033156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.033165 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.033192 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:51.033457 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.034190 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.035615 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.036195 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.036271 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.036280 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.036438 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.036469 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:51.036546 9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.032886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:35351 (local address 127.29.168.195:53727)
0808 14:40:51.032997 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:51.033007 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:51.033084 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:51.033265 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:51.033266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:51.033267 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:51.033367 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.033368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.034395 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.034395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.035524 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.035527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.036312 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.036313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.036382 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.036386 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:51.036433 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:40:51.036466 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":46,"threads_started":1}
I20260808 14:40:51.036684 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.032821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:47985 (local address 127.29.168.193:38227)
0808 14:40:51.032864 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.032866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.033093 (+ 227us) server_negotiation.cc:407] Connection header received
0808 14:40:51.033120 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.033121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.033132 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.033183 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:40:51.033401 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.034113 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.035737 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.036270 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.036339 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.036345 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.036582 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.036625 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:51.036981 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.032762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38227 (local address 127.29.168.195:47985)
0808 14:40:51.032971 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:51.032982 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:51.033029 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:51.033256 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:51.033257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:51.033259 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:40:51.033321 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.033322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.034346 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.034347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.035587 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.035590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.036349 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.036350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.036431 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.036435 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:40:51.036490 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:40:51.036528 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":32}
I20260808 14:40:51.037067 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf8b77c7a38f4391bb558dbdfb64fd52" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535" is_pre_election: true
I20260808 14:40:51.037185 9348 raft_consensus.cc:2454] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.037295 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf8b77c7a38f4391bb558dbdfb64fd52" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592" is_pre_election: true
I20260808 14:40:51.037372 9111 raft_consensus.cc:2454] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.037396 9470 leader_election.cc:302] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d718089ad34adbb31f4ebade8c7f37, fcbdb2ef87d14a86946220d251a70535; no voters:
I20260808 14:40:51.037546 9689 raft_consensus.cc:2781] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:51.037588 9689 raft_consensus.cc:482] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:51.037606 9689 raft_consensus.cc:3037] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.038118 9689 raft_consensus.cc:504] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.038235 9689 leader_election.cc:288] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Requested vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.038411 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf8b77c7a38f4391bb558dbdfb64fd52" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535"
I20260808 14:40:51.038441 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf8b77c7a38f4391bb558dbdfb64fd52" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592"
I20260808 14:40:51.038482 9348 raft_consensus.cc:3037] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.038515 9111 raft_consensus.cc:3037] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.039034 9348 raft_consensus.cc:2454] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.039196 9470 leader_election.cc:302] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d718089ad34adbb31f4ebade8c7f37, fcbdb2ef87d14a86946220d251a70535; no voters:
I20260808 14:40:51.039295 9689 raft_consensus.cc:2781] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:51.039443 9689 raft_consensus.cc:686] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Becoming Leader. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Running, Role: LEADER
I20260808 14:40:51.039551 9111 raft_consensus.cc:2454] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.039505 9689 consensus_queue.cc:237] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.040154 8876 catalog_manager.cc:5495] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } health_report { overall_health: HEALTHY } } }
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200050, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.254@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:51.067821 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.060419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45235 (local address 127.0.0.1:59674)
0808 14:40:51.060619 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:51.060631 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:51.060697 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:51.060840 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:51.060841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:51.061216 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:51.061264 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.061267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.061837 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.061838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.062621 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.062623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.062944 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.062945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.063014 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.063525 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:51.063530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:51.065045 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:51.066719 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:51.066725 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:51.066727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:51.066914 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:51.067112 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:51.067112 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:51.067113 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:51.067166 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:51.067424 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:51.067429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:51.067468 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:40:51.067519 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:40:51.067603 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":120,"threads_started":1}
I20260808 14:40:51.067838 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.060489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59674 (local address 127.29.168.254:45235)
0808 14:40:51.060563 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.060565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.060698 (+ 133us) server_negotiation.cc:407] Connection header received
0808 14:40:51.060754 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.060755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.060763 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.060810 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:51.061350 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.061764 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.062696 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.062858 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.062921 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.065130 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:51.065132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:51.065132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:51.065139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:51.066638 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:51.066985 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:51.066987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:51.066987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:51.067046 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:51.067225 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:51.067226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:51.067226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:51.067361 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:51.067429 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.067564 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.067709 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":50}
I20260808 14:40:51.069676 8876 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:59674:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:40:51.069888 8876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:51.071237 9082 tablet_service.cc:1467] Processing CreateTablet for tablet c18a54ac56f946dc89b6c6728e1c0870 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=de128aae1200495189e1c38c792ab42f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:51.071265 9531 tablet_service.cc:1467] Processing CreateTablet for tablet c18a54ac56f946dc89b6c6728e1c0870 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=de128aae1200495189e1c38c792ab42f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:51.071295 9315 tablet_service.cc:1467] Processing CreateTablet for tablet c18a54ac56f946dc89b6c6728e1c0870 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=de128aae1200495189e1c38c792ab42f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:40:51.071385 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c18a54ac56f946dc89b6c6728e1c0870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.071385 9082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c18a54ac56f946dc89b6c6728e1c0870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.071456 9315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c18a54ac56f946dc89b6c6728e1c0870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.072870 9679 tablet_bootstrap.cc:492] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: Bootstrap starting.
I20260808 14:40:51.072892 9678 tablet_bootstrap.cc:492] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: Bootstrap starting.
I20260808 14:40:51.073272 9678 tablet_bootstrap.cc:654] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.073279 9679 tablet_bootstrap.cc:654] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.073623 9680 tablet_bootstrap.cc:492] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: Bootstrap starting.
I20260808 14:40:51.074018 9679 tablet_bootstrap.cc:492] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: No bootstrap required, opened a new log
I20260808 14:40:51.074043 9680 tablet_bootstrap.cc:654] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.074064 9679 ts_tablet_manager.cc:1397] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:51.074209 9679 raft_consensus.cc:348] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.074275 9679 raft_consensus.cc:374] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.074301 9679 raft_consensus.cc:729] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.074352 9679 consensus_queue.cc:260] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.074461 9679 ts_tablet_manager.cc:1428] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:51.074589 9689 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.074658 9689 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.074908 9678 tablet_bootstrap.cc:492] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: No bootstrap required, opened a new log
I20260808 14:40:51.074962 9678 ts_tablet_manager.cc:1397] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:51.075107 9678 raft_consensus.cc:348] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.075181 9678 raft_consensus.cc:374] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.075202 9678 raft_consensus.cc:729] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c85de72056e4ed298c151bf91d55592, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.075242 9678 consensus_queue.cc:260] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.075340 9678 ts_tablet_manager.cc:1428] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.075393 9685 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.075481 9685 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.075647 9680 tablet_bootstrap.cc:492] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: No bootstrap required, opened a new log
I20260808 14:40:51.075726 9680 ts_tablet_manager.cc:1397] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:51.075866 9680 raft_consensus.cc:348] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.075920 9680 raft_consensus.cc:374] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.075937 9680 raft_consensus.cc:729] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbdb2ef87d14a86946220d251a70535, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.075975 9680 consensus_queue.cc:260] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.076069 9680 ts_tablet_manager.cc:1428] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.076085 9687 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.076149 9687 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.321206 9689 raft_consensus.cc:482] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:51.321301 9689 raft_consensus.cc:504] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.321499 9689 leader_election.cc:288] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.321784 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18a54ac56f946dc89b6c6728e1c0870" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535" is_pre_election: true
I20260808 14:40:51.321789 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18a54ac56f946dc89b6c6728e1c0870" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592" is_pre_election: true
I20260808 14:40:51.321882 9348 raft_consensus.cc:2454] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.321902 9111 raft_consensus.cc:2454] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.322041 9470 leader_election.cc:302] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, b3d718089ad34adbb31f4ebade8c7f37; no voters:
I20260808 14:40:51.322171 9689 raft_consensus.cc:2781] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:51.322227 9689 raft_consensus.cc:482] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:51.322240 9689 raft_consensus.cc:3037] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.322892 9689 raft_consensus.cc:504] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.323015 9689 leader_election.cc:288] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Requested vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.323215 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18a54ac56f946dc89b6c6728e1c0870" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535"
I20260808 14:40:51.323287 9348 raft_consensus.cc:3037] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.323247 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18a54ac56f946dc89b6c6728e1c0870" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592"
I20260808 14:40:51.323339 9111 raft_consensus.cc:3037] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.324119 9348 raft_consensus.cc:2454] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.324179 9111 raft_consensus.cc:2454] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.324338 9470 leader_election.cc:302] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d718089ad34adbb31f4ebade8c7f37, fcbdb2ef87d14a86946220d251a70535; no voters:
I20260808 14:40:51.324422 9689 raft_consensus.cc:2781] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:51.324479 9689 raft_consensus.cc:686] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Becoming Leader. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Running, Role: LEADER
I20260808 14:40:51.324528 9689 consensus_queue.cc:237] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } }
I20260808 14:40:51.324819 9729 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: TxnStatusTablet state changed. Reason: New leader b3d718089ad34adbb31f4ebade8c7f37. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.324905 9729 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:51.325189 9749 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:40:51.325217 8876 catalog_manager.cc:5495] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } health_report { overall_health: UNKNOWN } } }
I20260808 14:40:51.325309 9749 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:40:51.359398 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.356996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51936 (local address 127.29.168.195:41601)
0808 14:40:51.357044 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.357046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.357055 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:51.357132 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.357133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.357151 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.357225 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:51.357338 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.357805 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.358579 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.358787 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.358869 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.359060 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.359155 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.359236 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.359296 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.359317 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:40:51.359408 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.356903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:41601 (local address 127.0.0.1:51936)
0808 14:40:51.356980 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:51.356992 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:51.357042 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:51.357234 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:51.357235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:51.357236 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:51.357284 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.357286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.357901 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.357902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.358470 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.358472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.358869 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.358870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.358937 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.358954 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.359226 (+ 272us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.359236 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:40:51.359291 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:40:51.359344 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:40:51.360668 9111 raft_consensus.cc:1261] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.360770 9348 raft_consensus.cc:1261] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.360982 9689 consensus_queue.cc:1035] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.361162 9729 consensus_queue.cc:1035] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.361610 9685 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: TxnStatusTablet state changed. Reason: New leader b3d718089ad34adbb31f4ebade8c7f37. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.361696 9685 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.362046 9687 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: TxnStatusTablet state changed. Reason: New leader b3d718089ad34adbb31f4ebade8c7f37. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.362130 9687 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.362519 9702 mvcc.cc:205] Tried to move back new op lower bound from 7316275410371084288 to 7316275410225684480. Current Snapshot: MvccSnapshot[applied={T|T < 7316275410371084288}]
I20260808 14:40:51.362620 9729 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.362694 9729 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:51.363125 9689 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.363215 9689 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P b3d718089ad34adbb31f4ebade8c7f37: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:40:51.363505 9700 mvcc.cc:205] Tried to move back new op lower bound from 7316275410371084288 to 7316275410225684480. Current Snapshot: MvccSnapshot[applied={T|T < 7316275410371084288}]
I20260808 14:40:51.363585 9687 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.363696 9687 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P fcbdb2ef87d14a86946220d251a70535: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.363760 9685 tablet_replica.cc:439] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } }
I20260808 14:40:51.363842 9685 tablet_replica.cc:442] T c18a54ac56f946dc89b6c6728e1c0870 P 9c85de72056e4ed298c151bf91d55592: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:40:51.366791 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.364513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.29.168.195:41601)
0808 14:40:51.364577 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.364579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.364585 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:40:51.364601 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.364602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.364612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.364658 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:51.364928 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.365414 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.366132 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.366324 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.366404 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.366572 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.366602 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.366656 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.366707 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.366724 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:40:51.371809 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.369384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:60517 (local address 127.29.168.195:41601)
0808 14:40:51.369435 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.369437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.369569 (+ 132us) server_negotiation.cc:407] Connection header received
0808 14:40:51.369630 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.369631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.369637 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.369677 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:51.369834 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.370193 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.371172 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.371316 (+ 144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.371363 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.371581 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.371602 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.371689 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.371762 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.371774 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:40:51.371944 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.369313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:41601 (local address 127.29.168.195:60517)
0808 14:40:51.369501 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:51.369511 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:51.369573 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:51.369682 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:51.369682 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:51.369684 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:40:51.369772 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.369773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.370265 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.370265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.371094 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:51.371096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.371387 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.371388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:51.371446 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.371461 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.371699 (+ 238us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.371701 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:40:51.371762 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:40:51.371802 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":120,"threads_started":1}
I20260808 14:40:51.374029 9111 raft_consensus.cc:1261] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.374032 9348 raft_consensus.cc:1261] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.374258 9729 consensus_queue.cc:1035] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.374352 9689 consensus_queue.cc:1035] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.375900 9696 mvcc.cc:205] Tried to move back new op lower bound from 7316275410426667008 to 7316275409058680832. Current Snapshot: MvccSnapshot[applied={T|T < 7316275410426667008}]
I20260808 14:40:51.385183 8876 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.385285 8876 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.385926 8876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Sending DeleteTablet for 3 replicas of tablet bf8b77c7a38f4391bb558dbdfb64fd52
I20260808 14:40:51.386204 9082 tablet_service.cc:1514] Processing DeleteTablet for tablet bf8b77c7a38f4391bb558dbdfb64fd52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41878
I20260808 14:40:51.386230 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet bf8b77c7a38f4391bb558dbdfb64fd52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51922
I20260808 14:40:51.386231 9315 tablet_service.cc:1514] Processing DeleteTablet for tablet bf8b77c7a38f4391bb558dbdfb64fd52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39372
I20260808 14:40:51.386291 9713 tablet_replica.cc:330] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: stopping tablet replica
I20260808 14:40:51.386324 9722 tablet_replica.cc:330] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: stopping tablet replica
I20260808 14:40:51.386343 9713 raft_consensus.cc:2229] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.386373 9713 raft_consensus.cc:2258] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.386376 9722 raft_consensus.cc:2229] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.386408 9722 raft_consensus.cc:2258] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.386439 9718 tablet_replica.cc:330] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: stopping tablet replica
I20260808 14:40:51.386513 9718 raft_consensus.cc:2229] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:51.386601 9718 raft_consensus.cc:2258] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.386941 9718 ts_tablet_manager.cc:1905] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.386957 9722 ts_tablet_manager.cc:1905] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.388952 9718 ts_tablet_manager.cc:1918] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:51.388978 9722 ts_tablet_manager.cc:1918] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:51.389008 9718 log.cc:1196] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/bf8b77c7a38f4391bb558dbdfb64fd52
I20260808 14:40:51.389032 9722 log.cc:1196] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/bf8b77c7a38f4391bb558dbdfb64fd52
I20260808 14:40:51.389238 9718 ts_tablet_manager.cc:1939] T bf8b77c7a38f4391bb558dbdfb64fd52 P b3d718089ad34adbb31f4ebade8c7f37: Deleting consensus metadata
I20260808 14:40:51.389290 9722 ts_tablet_manager.cc:1939] T bf8b77c7a38f4391bb558dbdfb64fd52 P fcbdb2ef87d14a86946220d251a70535: Deleting consensus metadata
I20260808 14:40:51.389596 8852 catalog_manager.cc:4841] TS fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351): tablet bf8b77c7a38f4391bb558dbdfb64fd52 (table test-table [id=58c9048518344416a7f8bb4f1feb8974]) successfully deleted
I20260808 14:40:51.389649 8849 catalog_manager.cc:4841] TS b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601): tablet bf8b77c7a38f4391bb558dbdfb64fd52 (table test-table [id=58c9048518344416a7f8bb4f1feb8974]) successfully deleted
I20260808 14:40:51.390563 9713 ts_tablet_manager.cc:1905] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.392264 9713 ts_tablet_manager.cc:1918] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:51.392313 9713 log.cc:1196] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/bf8b77c7a38f4391bb558dbdfb64fd52
I20260808 14:40:51.392493 9713 ts_tablet_manager.cc:1939] T bf8b77c7a38f4391bb558dbdfb64fd52 P 9c85de72056e4ed298c151bf91d55592: Deleting consensus metadata
I20260808 14:40:51.392802 8852 catalog_manager.cc:4841] TS 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227): tablet bf8b77c7a38f4391bb558dbdfb64fd52 (table test-table [id=58c9048518344416a7f8bb4f1feb8974]) successfully deleted
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[8805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:40:51.411729 8951 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:51.405620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59688 (local address 127.29.168.254:45235)
0808 14:40:51.405687 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.405690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.405818 (+ 128us) server_negotiation.cc:407] Connection header received
0808 14:40:51.405893 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.405894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.405902 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.405949 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:51.406723 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.407196 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.408289 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.408471 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.408522 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.411590 (+ 3068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59688: BlockingRecv error: recv got EOF from 127.0.0.1:59688 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[8805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM
I20260808 14:40:51.419842 8951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.412497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59690 (local address 127.29.168.254:45235)
0808 14:40:51.412535 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.412537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.412602 (+ 65us) server_negotiation.cc:407] Connection header received
0808 14:40:51.412661 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.412662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.412669 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.412711 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:51.413264 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.413656 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.414598 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.414806 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.414864 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.417312 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:51.417314 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:51.417314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:51.417321 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:51.418654 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:51.419001 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:51.419003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:51.419003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:51.419071 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:51.419258 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:51.419259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:51.419259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:51.419363 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:51.419458 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.419620 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.419741 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:40:51.421525 8876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:40:51.421717 8876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:51.423127 9082 tablet_service.cc:1467] Processing CreateTablet for tablet 6d43bfa3c238414d9d13025322675e14 (DEFAULT_TABLE table=test-table [id=c59f83f75b83459eaeb4973bef05574a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.423164 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 6d43bfa3c238414d9d13025322675e14 (DEFAULT_TABLE table=test-table [id=c59f83f75b83459eaeb4973bef05574a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.423187 9315 tablet_service.cc:1467] Processing CreateTablet for tablet 6d43bfa3c238414d9d13025322675e14 (DEFAULT_TABLE table=test-table [id=c59f83f75b83459eaeb4973bef05574a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.423260 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d43bfa3c238414d9d13025322675e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.423259 9082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d43bfa3c238414d9d13025322675e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.423332 9315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d43bfa3c238414d9d13025322675e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.424553 9679 tablet_bootstrap.cc:492] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Bootstrap starting.
I20260808 14:40:51.424553 9678 tablet_bootstrap.cc:492] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Bootstrap starting.
I20260808 14:40:51.424836 9680 tablet_bootstrap.cc:492] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Bootstrap starting.
I20260808 14:40:51.424964 9679 tablet_bootstrap.cc:654] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.424979 9678 tablet_bootstrap.cc:654] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.425150 9680 tablet_bootstrap.cc:654] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.426033 9680 tablet_bootstrap.cc:492] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: No bootstrap required, opened a new log
I20260808 14:40:51.426075 9679 tablet_bootstrap.cc:492] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: No bootstrap required, opened a new log
I20260808 14:40:51.426090 9680 ts_tablet_manager.cc:1397] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:51.426122 9679 ts_tablet_manager.cc:1397] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:40:51.426152 9678 tablet_bootstrap.cc:492] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: No bootstrap required, opened a new log
I20260808 14:40:51.426195 9678 ts_tablet_manager.cc:1397] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:51.426200 9680 raft_consensus.cc:348] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.426286 9680 raft_consensus.cc:374] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.426308 9680 raft_consensus.cc:729] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbdb2ef87d14a86946220d251a70535, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.426291 9679 raft_consensus.cc:348] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.426354 9679 raft_consensus.cc:374] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.426374 9679 raft_consensus.cc:729] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.426357 9680 consensus_queue.cc:260] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.426342 9678 raft_consensus.cc:348] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.426411 9678 raft_consensus.cc:374] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.426433 9678 raft_consensus.cc:729] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c85de72056e4ed298c151bf91d55592, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.426414 9679 consensus_queue.cc:260] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.426458 9680 ts_tablet_manager.cc:1428] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.426486 9678 consensus_queue.cc:260] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.426517 9679 ts_tablet_manager.cc:1428] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:51.426589 9678 ts_tablet_manager.cc:1428] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:51.731119 9758 raft_consensus.cc:482] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:51.731205 9758 raft_consensus.cc:504] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.731369 9758 leader_election.cc:288] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.731616 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d43bfa3c238414d9d13025322675e14" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592" is_pre_election: true
I20260808 14:40:51.731787 9111 raft_consensus.cc:2454] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.731684 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d43bfa3c238414d9d13025322675e14" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535" is_pre_election: true
I20260808 14:40:51.731870 9348 raft_consensus.cc:2454] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.731951 9470 leader_election.cc:302] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, b3d718089ad34adbb31f4ebade8c7f37; no voters:
I20260808 14:40:51.732030 9758 raft_consensus.cc:2781] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:51.732059 9758 raft_consensus.cc:482] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:51.732077 9758 raft_consensus.cc:3037] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.732784 9758 raft_consensus.cc:504] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.732956 9758 leader_election.cc:288] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Requested vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.733136 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d43bfa3c238414d9d13025322675e14" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592"
I20260808 14:40:51.733180 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d43bfa3c238414d9d13025322675e14" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535"
I20260808 14:40:51.733227 9111 raft_consensus.cc:3037] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.733266 9348 raft_consensus.cc:3037] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.733944 9111 raft_consensus.cc:2454] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.734154 9348 raft_consensus.cc:2454] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.734184 9470 leader_election.cc:302] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, b3d718089ad34adbb31f4ebade8c7f37; no voters:
I20260808 14:40:51.734275 9758 raft_consensus.cc:2781] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:51.734328 9758 raft_consensus.cc:686] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Becoming Leader. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Running, Role: LEADER
I20260808 14:40:51.734380 9758 consensus_queue.cc:237] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.734959 8876 catalog_manager.cc:5495] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260808 14:40:51.779235 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.777298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51956 (local address 127.29.168.195:41601)
0808 14:40:51.777337 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:51.777339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:51.777369 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:40:51.777418 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:51.777419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:51.777428 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:51.777468 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:40:51.777615 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.778042 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.778688 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:51.778889 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:51.778940 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:51.779065 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:40:51.779087 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:40:51.779120 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:51.779174 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:40:51.779186 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:40:51.780073 9348 raft_consensus.cc:1261] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.780083 9111 raft_consensus.cc:1261] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.780316 9729 consensus_queue.cc:1035] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.780423 9758 consensus_queue.cc:1035] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.782648 8876 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.782730 8876 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.783315 8876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Sending DeleteTablet for 3 replicas of tablet 6d43bfa3c238414d9d13025322675e14
I20260808 14:40:51.783540 9082 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d43bfa3c238414d9d13025322675e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41878
I20260808 14:40:51.783565 9315 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d43bfa3c238414d9d13025322675e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39372
I20260808 14:40:51.783630 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d43bfa3c238414d9d13025322675e14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51922
I20260808 14:40:51.783663 9722 tablet_replica.cc:330] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: stopping tablet replica
I20260808 14:40:51.783728 9713 tablet_replica.cc:330] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: stopping tablet replica
I20260808 14:40:51.783726 9718 tablet_replica.cc:330] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: stopping tablet replica
I20260808 14:40:51.783717 9722 raft_consensus.cc:2229] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.783772 9713 raft_consensus.cc:2229] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.783772 9718 raft_consensus.cc:2229] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:51.783775 9722 raft_consensus.cc:2258] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.783816 9713 raft_consensus.cc:2258] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.783749 8876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:40:51.783833 9718 raft_consensus.cc:2258] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 14:40:51.783929 8876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:40:51.784147 9722 ts_tablet_manager.cc:1905] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.784351 9718 ts_tablet_manager.cc:1905] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.785732 9722 ts_tablet_manager.cc:1918] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:51.785796 9722 log.cc:1196] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/6d43bfa3c238414d9d13025322675e14
I20260808 14:40:51.785784 9718 ts_tablet_manager.cc:1918] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:51.785833 9718 log.cc:1196] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/6d43bfa3c238414d9d13025322675e14
I20260808 14:40:51.786023 9722 ts_tablet_manager.cc:1939] T 6d43bfa3c238414d9d13025322675e14 P fcbdb2ef87d14a86946220d251a70535: Deleting consensus metadata
I20260808 14:40:51.786031 9718 ts_tablet_manager.cc:1939] T 6d43bfa3c238414d9d13025322675e14 P b3d718089ad34adbb31f4ebade8c7f37: Deleting consensus metadata
I20260808 14:40:51.786376 8852 catalog_manager.cc:4841] TS fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351): tablet 6d43bfa3c238414d9d13025322675e14 (table test-table [id=c59f83f75b83459eaeb4973bef05574a]) successfully deleted
I20260808 14:40:51.786391 8849 catalog_manager.cc:4841] TS b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601): tablet 6d43bfa3c238414d9d13025322675e14 (table test-table [id=c59f83f75b83459eaeb4973bef05574a]) successfully deleted
I20260808 14:40:51.786464 9713 ts_tablet_manager.cc:1905] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.786994 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 07b83a940d55449080b2c53f2476a763 (DEFAULT_TABLE table=test-table [id=0b70a7bb32ad4a35b5a5241cebb30861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.787001 9315 tablet_service.cc:1467] Processing CreateTablet for tablet 07b83a940d55449080b2c53f2476a763 (DEFAULT_TABLE table=test-table [id=0b70a7bb32ad4a35b5a5241cebb30861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.787053 9082 tablet_service.cc:1467] Processing CreateTablet for tablet 07b83a940d55449080b2c53f2476a763 (DEFAULT_TABLE table=test-table [id=0b70a7bb32ad4a35b5a5241cebb30861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:40:51.787102 9315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b83a940d55449080b2c53f2476a763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.787108 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b83a940d55449080b2c53f2476a763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.787146 9082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b83a940d55449080b2c53f2476a763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:51.788146 9713 ts_tablet_manager.cc:1918] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:40:51.788203 9713 log.cc:1196] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/6d43bfa3c238414d9d13025322675e14
I20260808 14:40:51.788355 9679 tablet_bootstrap.cc:492] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Bootstrap starting.
I20260808 14:40:51.788434 9713 ts_tablet_manager.cc:1939] T 6d43bfa3c238414d9d13025322675e14 P 9c85de72056e4ed298c151bf91d55592: Deleting consensus metadata
I20260808 14:40:51.788427 9680 tablet_bootstrap.cc:492] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Bootstrap starting.
I20260808 14:40:51.788697 9679 tablet_bootstrap.cc:654] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.788749 9680 tablet_bootstrap.cc:654] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.788790 8852 catalog_manager.cc:4841] TS 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227): tablet 6d43bfa3c238414d9d13025322675e14 (table test-table [id=c59f83f75b83459eaeb4973bef05574a]) successfully deleted
I20260808 14:40:51.788949 9678 tablet_bootstrap.cc:492] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: Bootstrap starting.
I20260808 14:40:51.789278 9680 tablet_bootstrap.cc:492] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: No bootstrap required, opened a new log
I20260808 14:40:51.789309 9680 ts_tablet_manager.cc:1397] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:51.789381 9680 raft_consensus.cc:348] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.789418 9680 raft_consensus.cc:374] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.789434 9680 raft_consensus.cc:729] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbdb2ef87d14a86946220d251a70535, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.789503 9678 tablet_bootstrap.cc:654] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:51.789494 9680 consensus_queue.cc:260] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.789584 9680 ts_tablet_manager.cc:1428] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.789956 9679 tablet_bootstrap.cc:492] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: No bootstrap required, opened a new log
I20260808 14:40:51.790019 9679 ts_tablet_manager.cc:1397] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:40:51.790139 9679 raft_consensus.cc:348] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.790192 9679 raft_consensus.cc:374] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.790205 9679 raft_consensus.cc:729] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.790222 9679 consensus_queue.cc:260] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.790275 9679 ts_tablet_manager.cc:1428] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.790475 9678 tablet_bootstrap.cc:492] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: No bootstrap required, opened a new log
I20260808 14:40:51.790505 9678 ts_tablet_manager.cc:1397] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:40:51.790634 9678 raft_consensus.cc:348] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.790688 9678 raft_consensus.cc:374] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:51.790705 9678 raft_consensus.cc:729] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c85de72056e4ed298c151bf91d55592, State: Initialized, Role: FOLLOWER
I20260808 14:40:51.790741 9678 consensus_queue.cc:260] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.790825 9678 ts_tablet_manager.cc:1428] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:51.875315 9758 raft_consensus.cc:482] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:40:51.875393 9758 raft_consensus.cc:504] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.875504 9758 leader_election.cc:288] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.875756 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b83a940d55449080b2c53f2476a763" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592" is_pre_election: true
I20260808 14:40:51.875758 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b83a940d55449080b2c53f2476a763" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535" is_pre_election: true
I20260808 14:40:51.875851 9111 raft_consensus.cc:2454] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.875849 9348 raft_consensus.cc:2454] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 0.
I20260808 14:40:51.876010 9470 leader_election.cc:302] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, b3d718089ad34adbb31f4ebade8c7f37; no voters:
I20260808 14:40:51.876147 9758 raft_consensus.cc:2781] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:40:51.876195 9758 raft_consensus.cc:482] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:40:51.876225 9758 raft_consensus.cc:3037] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.876894 9758 raft_consensus.cc:504] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.877020 9758 leader_election.cc:288] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Requested vote from peers 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227), fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351)
I20260808 14:40:51.877178 9111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b83a940d55449080b2c53f2476a763" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85de72056e4ed298c151bf91d55592"
I20260808 14:40:51.877290 9111 raft_consensus.cc:3037] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.877840 9111 raft_consensus.cc:2454] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.877961 9348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b83a940d55449080b2c53f2476a763" candidate_uuid: "b3d718089ad34adbb31f4ebade8c7f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcbdb2ef87d14a86946220d251a70535"
I20260808 14:40:51.878016 9470 leader_election.cc:302] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85de72056e4ed298c151bf91d55592, b3d718089ad34adbb31f4ebade8c7f37; no voters:
I20260808 14:40:51.878043 9348 raft_consensus.cc:3037] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:51.878110 9758 raft_consensus.cc:2781] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:51.878157 9758 raft_consensus.cc:686] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Becoming Leader. State: Replica: b3d718089ad34adbb31f4ebade8c7f37, State: Running, Role: LEADER
I20260808 14:40:51.878206 9758 consensus_queue.cc:237] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } }
I20260808 14:40:51.878652 8876 catalog_manager.cc:5495] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "b3d718089ad34adbb31f4ebade8c7f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d718089ad34adbb31f4ebade8c7f37" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260808 14:40:51.878782 9348 raft_consensus.cc:2454] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d718089ad34adbb31f4ebade8c7f37 in term 1.
I20260808 14:40:51.884124 9348 raft_consensus.cc:1261] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.884172 9111 raft_consensus.cc:1261] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Refusing update from remote peer b3d718089ad34adbb31f4ebade8c7f37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:40:51.884311 9758 consensus_queue.cc:1035] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcbdb2ef87d14a86946220d251a70535" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.884407 9689 consensus_queue.cc:1035] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c85de72056e4ed298c151bf91d55592" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:40:51.894182 8875 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.894277 8875 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:40:51.894814 8875 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79fb37b9d1d6449f8ca790a2a1e41681: Sending DeleteTablet for 3 replicas of tablet 07b83a940d55449080b2c53f2476a763
I20260808 14:40:51.895077 9315 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b83a940d55449080b2c53f2476a763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:39372
I20260808 14:40:51.895080 9082 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b83a940d55449080b2c53f2476a763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41878
I20260808 14:40:51.895203 9722 tablet_replica.cc:330] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: stopping tablet replica
I20260808 14:40:51.895217 9713 tablet_replica.cc:330] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: stopping tablet replica
I20260808 14:40:51.895219 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b83a940d55449080b2c53f2476a763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:40:51 UTC) from {username='oryx', principal='oryx/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:51922
I20260808 14:40:51.895272 9713 raft_consensus.cc:2229] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.895274 9722 raft_consensus.cc:2229] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:40:51.895292 9718 tablet_replica.cc:330] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: stopping tablet replica
I20260808 14:40:51.895305 9722 raft_consensus.cc:2258] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.895304 9713 raft_consensus.cc:2258] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.895339 9718 raft_consensus.cc:2229] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:40:51.895385 9718 raft_consensus.cc:2258] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:40:51.895694 9713 ts_tablet_manager.cc:1905] T 07b83a940d55449080b2c53f2476a763 P 9c85de72056e4ed298c151bf91d55592: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.895756 9722 ts_tablet_manager.cc:1905] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.895970 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 8985
I20260808 14:40:51.897128 9722 ts_tablet_manager.cc:1918] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:51.897172 9722 log.cc:1196] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/07b83a940d55449080b2c53f2476a763
I20260808 14:40:51.897369 9722 ts_tablet_manager.cc:1939] T 07b83a940d55449080b2c53f2476a763 P fcbdb2ef87d14a86946220d251a70535: Deleting consensus metadata
I20260808 14:40:51.902359 9718 ts_tablet_manager.cc:1905] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:40:51.904381 9718 ts_tablet_manager.cc:1918] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:40:51.904436 9718 log.cc:1196] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/07b83a940d55449080b2c53f2476a763
I20260808 14:40:51.904649 9718 ts_tablet_manager.cc:1939] T 07b83a940d55449080b2c53f2476a763 P b3d718089ad34adbb31f4ebade8c7f37: Deleting consensus metadata
I20260808 14:40:51.904963 8849 catalog_manager.cc:4841] TS b3d718089ad34adbb31f4ebade8c7f37 (127.29.168.195:41601): tablet 07b83a940d55449080b2c53f2476a763 (table test-table [id=0b70a7bb32ad4a35b5a5241cebb30861]) successfully deleted
I20260808 14:40:51.905357 8852 catalog_manager.cc:4841] TS fcbdb2ef87d14a86946220d251a70535 (127.29.168.194:35351): tablet 07b83a940d55449080b2c53f2476a763 (table test-table [id=0b70a7bb32ad4a35b5a5241cebb30861]) successfully deleted
W20260808 14:40:51.909775 8852 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:38227 (error 108)
I20260808 14:40:51.910272 9805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:51.910118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38227 (local address 127.0.0.1:41884)
0808 14:40:51.910205 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:51.910240 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":44,"threads_started":1}
W20260808 14:40:51.910394 8852 catalog_manager.cc:4584] TS 9c85de72056e4ed298c151bf91d55592 (127.29.168.193:38227): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 07b83a940d55449080b2c53f2476a763: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38227: connect: Connection refused (error 111)
I20260808 14:40:51.910431 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 9202
I20260808 14:40:51.922055 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 9441
I20260808 14:40:51.937582 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 8827
2026-08-08T14:40:51Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3243 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[9811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[9811](info): set up 2 sockets
Aug 08 14:40:51 dist-test-slave-mjjr krb5kdc[9811](info): commencing operation
krb5kdc: starting...
W20260808 14:40:53.104351 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:53 dist-test-slave-mjjr krb5kdc[9811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:53.216533 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44241
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:41269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:53.297925 9839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:53.298156 9839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:53.298197 9839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:53.299345 9839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:53.299410 9839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:53.299434 9839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:53.299456 9839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:53.299485 9839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:53.300985 9839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:53.301306 9839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:53.301555 9839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:53.306540 9847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:53.306488 9849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:53.306517 9839 server_base.cc:1034] running on GCE node
W20260808 14:40:53.306485 9852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:53.307098 9839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:53.307425 9839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:53.308610 9839 hybrid_clock.cc:648] HybridClock initialized: now 1786200053308569 us; error 72 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T14:40:53Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1372 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:40:53 dist-test-slave-mjjr krb5kdc[9858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:40:53 dist-test-slave-mjjr krb5kdc[9858](info): set up 2 sockets
Aug 08 14:40:53 dist-test-slave-mjjr krb5kdc[9858](info): commencing operation
krb5kdc: starting...
W20260808 14:40:54.490957 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:40:54 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:40:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:40:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:40:54.605911 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33149
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:54.701314 9875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:54.701534 9875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:54.701568 9875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:54.702580 9875 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:54.702641 9875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:54.702665 9875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:54.702694 9875 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:54.702716 9875 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:54.704187 9875 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:54.704476 9875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:54.704684 9875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:54.709264 9882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:54.709344 9884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:54.709364 9881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:54.709422 9875 server_base.cc:1034] running on GCE node
I20260808 14:40:54.709779 9875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:54.710089 9875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:54.711221 9875 hybrid_clock.cc:648] HybridClock initialized: now 1786200054711207 us; error 26 us; skew 500 ppm
Aug 08 14:40:54 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200054, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:54.713514 9875 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:54.713923 9875 webserver.cc:460] Webserver started at http://127.29.168.254:40903/ using document root <none> and password file <none>
I20260808 14:40:54.714150 9875 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:54.714221 9875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:54.714373 9875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:54.715345 9875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "b2231dfaa567405aa27e1bbe62249534"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "b10dfaee56730b8b1bfba0cdfaf65415"
server_key_iv: "9c6ce1368795acea8ea6f13c7d28bf67"
server_key_version: "encryptionkey@0"
I20260808 14:40:54.715757 9875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "b2231dfaa567405aa27e1bbe62249534"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "b10dfaee56730b8b1bfba0cdfaf65415"
server_key_iv: "9c6ce1368795acea8ea6f13c7d28bf67"
server_key_version: "encryptionkey@0"
I20260808 14:40:54.717028 9875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:54.717722 9892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:54.717897 9875 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:54.717991 9875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "b2231dfaa567405aa27e1bbe62249534"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "b10dfaee56730b8b1bfba0cdfaf65415"
server_key_iv: "9c6ce1368795acea8ea6f13c7d28bf67"
server_key_version: "encryptionkey@0"
I20260808 14:40:54.718083 9875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:54.729709 9875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:54.731290 9875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:54.731448 9875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:54.735102 9875 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33149
I20260808 14:40:54.735148 9983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33149 every 8 connection(s)
I20260808 14:40:54.735620 9875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:54.736270 9984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:40:54.738281 9984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Bootstrap starting.
I20260808 14:40:54.738819 9984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Neither blocks nor log segments found. Creating new log.
I20260808 14:40:54.739109 9984 log.cc:824] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:54.739806 9984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: No bootstrap required, opened a new log
I20260808 14:40:54.740345 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 9875
I20260808 14:40:54.740434 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:40:54.740622 30371 external_mini_cluster.cc:1428] Setting key 9b27d0c47c5921a131d18ae7d0dc7e3f
I20260808 14:40:54.741830 9984 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:54.741974 9984 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:40:54.742007 9984 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2231dfaa567405aa27e1bbe62249534, State: Initialized, Role: FOLLOWER
I20260808 14:40:54.742138 9984 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:54.742210 9984 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:54.742231 9984 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:54.742290 9984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:40:54.743455 9984 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:54.743551 9984 leader_election.cc:302] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2231dfaa567405aa27e1bbe62249534; no voters:
I20260808 14:40:54.743702 9984 leader_election.cc:288] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:40:54.743763 9990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:40:54.743948 9984 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:54.743966 9990 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 LEADER]: Becoming Leader. State: Replica: b2231dfaa567405aa27e1bbe62249534, State: Running, Role: LEADER
I20260808 14:40:54.744047 9990 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:54.745097 9992 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2231dfaa567405aa27e1bbe62249534. Latest consensus state: current_term: 1 leader_uuid: "b2231dfaa567405aa27e1bbe62249534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } } }
I20260808 14:40:54.745187 9992 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:54.745332 9991 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2231dfaa567405aa27e1bbe62249534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } } }
I20260808 14:40:54.745425 9991 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: This master's current role is: LEADER
W20260808 14:40:54.745955 10017 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:40:54.746089 10017 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:40:54.746290 10014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:54.746479 10014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:40:54 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:54.747964 10014 catalog_manager.cc:1347] Generated new cluster ID: 0b2c2ccabf504f1a84f6940d435699a4
I20260808 14:40:54.748024 10014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:54.751917 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:54.741071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.29.168.254:33149)
0808 14:40:54.741229 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:54.741237 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:54.741276 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:40:54.741799 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:54.741807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:54.741861 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:54.741992 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:54.742666 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:54.744021 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:54.745134 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:54.745757 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:54.745870 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:54.748421 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:54.748425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:54.748425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:54.748435 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:54.750301 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:54.750702 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:54.750705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:54.750705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:54.750827 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:54.751031 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:54.751032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:54.751032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:54.751337 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:54.751500 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:54.751566 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 14:40:54.751719 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260808 14:40:54.769212 10014 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:40:54.769922 10014 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:54.773483 10014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Generated new TSK 0
I20260808 14:40:54.773635 10014 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:40:54.802325 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33149
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:54.882817 10022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:54.883025 10022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:54.883047 10022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:54.884253 10022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:54.884301 10022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:54.884356 10022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:54.885825 10022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:54.886080 10022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:54.886310 10022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:54.891256 10039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:54.891251 10032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:54.891249 10033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:54.891381 10022 server_base.cc:1034] running on GCE node
I20260808 14:40:54.891757 10022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:54.892045 10022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:54.893211 10022 hybrid_clock.cc:648] HybridClock initialized: now 1786200054893195 us; error 33 us; skew 500 ppm
Aug 08 14:40:54 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200054, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:54.895875 10022 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:40:54.896297 10022 webserver.cc:460] Webserver started at http://127.29.168.193:42711/ using document root <none> and password file <none>
I20260808 14:40:54.896530 10022 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:54.896597 10022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:54.896764 10022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:54.897775 10022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "40b2a03266df45ed80906a7ad7cec891"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "0b708e2ab4bc3e82c7811a1ddfa509b0"
server_key_iv: "67f135db0b2a6996dcc5a89a480c9f89"
server_key_version: "encryptionkey@0"
I20260808 14:40:54.898144 10022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "40b2a03266df45ed80906a7ad7cec891"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "0b708e2ab4bc3e82c7811a1ddfa509b0"
server_key_iv: "67f135db0b2a6996dcc5a89a480c9f89"
server_key_version: "encryptionkey@0"
I20260808 14:40:54.899497 10022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:54.900275 10049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:54.900461 10022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:54.900555 10022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "40b2a03266df45ed80906a7ad7cec891"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "0b708e2ab4bc3e82c7811a1ddfa509b0"
server_key_iv: "67f135db0b2a6996dcc5a89a480c9f89"
server_key_version: "encryptionkey@0"
I20260808 14:40:54.900640 10022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:54.933450 10022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:54.935673 10022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:54.935855 10022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:54.936094 10022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:54.936391 10022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:54.936452 10022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:54.936486 10022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:54.936512 10022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:54.942044 10022 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:40635
I20260808 14:40:54.942096 10215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:40635 every 8 connection(s)
I20260808 14:40:54.942373 10022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:40:54.947405 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 10022
I20260808 14:40:54.947500 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:40:54.947729 30371 external_mini_cluster.cc:1428] Setting key 215aa4009e9614a8edab3037f58f239a
Aug 08 14:40:54 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200054, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:54.952098 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:54.943042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:34807 (local address 127.29.168.254:33149)
0808 14:40:54.943103 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:54.943105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:54.943277 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:40:54.943719 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:54.943720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:54.943732 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:54.943781 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:54.944691 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:54.945309 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:54.946216 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:54.946413 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:54.946462 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:54.948928 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:54.948929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:54.948929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:54.948936 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:54.950490 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:54.950957 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:54.950959 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:54.950959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:54.951030 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:54.951266 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:54.951268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:54.951268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:54.951400 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:54.951521 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:54.951962 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 14:40:54.952035 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:40:54.952366 10219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:54.943012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:34807)
0808 14:40:54.943156 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:54.943193 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:54.943618 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:54.943825 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:54.943827 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:54.944428 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:54.944610 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:54.944614 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:54.945388 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:54.945389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:54.946144 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:54.946146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:54.946495 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:54.946496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:54.946615 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:54.947114 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:54.947122 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:54.948830 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:54.950642 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:54.950648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:54.950650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:54.950861 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:54.951105 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:54.951106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:54.951107 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:54.951201 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:54.951625 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:54.951657 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:54.951822 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 14:40:54.951938 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:40:54.952105 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
I20260808 14:40:54.952991 10217 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33149
I20260808 14:40:54.953090 10217 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:54.953271 10217 heartbeater.cc:511] Master 127.29.168.254:33149 requested a full tablet report, sending...
I20260808 14:40:54.953785 9916 ts_manager.cc:194] Registered new tserver with Master: 40b2a03266df45ed80906a7ad7cec891 (127.29.168.193:40635)
I20260808 14:40:54.954753 9916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:34807
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:40:54.972182 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33149
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:55.049273 10222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:55.049456 10222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:55.049476 10222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:55.050491 10222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:55.050534 10222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:55.050558 10222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:55.052016 10222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:55.052205 10222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:55.052361 10222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:55.057240 10231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.057250 10228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.057245 10229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.057541 10222 server_base.cc:1034] running on GCE node
I20260808 14:40:55.057682 10222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:55.057843 10222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:55.058979 10222 hybrid_clock.cc:648] HybridClock initialized: now 1786200055058979 us; error 38 us; skew 500 ppm
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:55.061244 10222 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:40:55.061666 10222 webserver.cc:460] Webserver started at http://127.29.168.194:45135/ using document root <none> and password file <none>
I20260808 14:40:55.061905 10222 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:55.061959 10222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:55.062099 10222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:55.063122 10222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "586c94b091364dd9bb35def221a162d6"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "75b5bd13931febcef9abdea43820ff79"
server_key_iv: "4511dc7f8c32122966268d180da0a112"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.063467 10222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "586c94b091364dd9bb35def221a162d6"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "75b5bd13931febcef9abdea43820ff79"
server_key_iv: "4511dc7f8c32122966268d180da0a112"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.064819 10222 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:40:55.065537 10244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.065714 10222 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:55.065822 10222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "586c94b091364dd9bb35def221a162d6"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "75b5bd13931febcef9abdea43820ff79"
server_key_iv: "4511dc7f8c32122966268d180da0a112"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.065901 10222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:55.075263 10222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:55.076913 10222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:55.077060 10222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:55.077250 10222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:55.077527 10222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:55.077579 10222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.077615 10222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:55.077639 10222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.083267 10222 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38073
I20260808 14:40:55.083320 10414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38073 every 8 connection(s)
I20260808 14:40:55.083590 10222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:55.086934 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 10222
I20260808 14:40:55.087049 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:40:55.087239 30371 external_mini_cluster.cc:1428] Setting key 5f9f9739b935c1e4d381f48e120ad553
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:55.093106 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.084396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:54547 (local address 127.29.168.254:33149)
0808 14:40:55.084463 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.084466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.084633 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:40:55.085119 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.085120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.085133 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.085187 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.086095 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.086623 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.088052 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.088241 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.088302 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.090458 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:55.090460 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:55.090460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:55.090468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:55.091879 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:55.092262 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:55.092263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:55.092264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:55.092322 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:55.092545 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:55.092546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:55.092546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:55.092646 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:55.092714 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:55.092944 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 14:40:55.093028 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:40:55.093233 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.084368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:54547)
0808 14:40:55.084516 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.084556 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.085015 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.085250 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.085259 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.085827 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.085996 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.086000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.086719 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.086720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.087966 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.087969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.088322 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.088331 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.088464 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.088909 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.088918 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.090370 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:55.091999 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:55.092006 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:55.092009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:55.092191 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:55.092387 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:55.092389 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:55.092390 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:55.092484 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:55.092708 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:55.092714 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:55.092826 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 14:40:55.092914 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:40:55.093042 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260808 14:40:55.093606 10415 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33149
I20260808 14:40:55.093685 10415 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:55.093850 10415 heartbeater.cc:511] Master 127.29.168.254:33149 requested a full tablet report, sending...
I20260808 14:40:55.094211 9916 ts_manager.cc:194] Registered new tserver with Master: 586c94b091364dd9bb35def221a162d6 (127.29.168.194:38073)
I20260808 14:40:55.094605 9916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:54547
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:40:55.112249 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33149
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:55.190090 10424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:55.190256 10424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:55.190277 10424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:55.191303 10424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:55.191339 10424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:55.191362 10424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:55.192629 10424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:55.192888 10424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:55.193109 10424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:40:55.197844 10424 server_base.cc:1034] running on GCE node
W20260808 14:40:55.197721 10431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.197732 10432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.197736 10434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.198163 10424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:55.198400 10424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:55.199559 10424 hybrid_clock.cc:648] HybridClock initialized: now 1786200055199551 us; error 36 us; skew 500 ppm
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:55.201956 10424 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:40:55.202296 10424 webserver.cc:460] Webserver started at http://127.29.168.195:38445/ using document root <none> and password file <none>
I20260808 14:40:55.202476 10424 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:55.202512 10424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:55.202589 10424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:40:55.203480 10424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "a32687fffed7482fb0972f573c11da4c"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "a237590bf62d568dfb05cce93f5d1499"
server_key_iv: "e4ebc05e48482778887aac23b2eb92a5"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.203814 10424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "a32687fffed7482fb0972f573c11da4c"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "a237590bf62d568dfb05cce93f5d1499"
server_key_iv: "e4ebc05e48482778887aac23b2eb92a5"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.205014 10424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:55.205684 10443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.205817 10424 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:40:55.205886 10424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "a32687fffed7482fb0972f573c11da4c"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "a237590bf62d568dfb05cce93f5d1499"
server_key_iv: "e4ebc05e48482778887aac23b2eb92a5"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.205956 10424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:55.225047 10424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:55.227121 10424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:55.227226 10424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:55.227404 10424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:55.227661 10424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:55.227692 10424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.227736 10424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:55.227785 10424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.233520 10424 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45525
I20260808 14:40:55.233567 10630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45525 every 8 connection(s)
I20260808 14:40:55.233831 10424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:55.236696 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 10424
I20260808 14:40:55.236842 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:40:55.237066 30371 external_mini_cluster.cc:1428] Setting key 881d7321dc077ca7d12fe6c315773eb3
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:40:55.242480 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.234576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:39825 (local address 127.29.168.254:33149)
0808 14:40:55.234659 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.234661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.234758 (+ 97us) server_negotiation.cc:407] Connection header received
0808 14:40:55.235207 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.235208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.235218 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.235271 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.236200 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.236621 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.237909 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.238158 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.238206 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.240055 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:55.240056 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:55.240057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:55.240062 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:55.241421 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:55.241777 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:55.241777 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:55.241778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:55.241824 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:55.242028 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:55.242029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:55.242029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:55.242116 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:55.242161 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:55.242370 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 14:40:55.242422 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:40:55.242640 10633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.234477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:39825)
0808 14:40:55.234632 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.234676 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.235123 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.235377 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.235382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.235938 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.236113 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.236118 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.236709 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.236711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.237821 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.237825 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.238232 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.238233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.238327 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.238695 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.238702 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.239976 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:40:55.241493 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:55.241499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:55.241500 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:55.241712 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:55.241883 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:40:55.241883 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:40:55.241884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:40:55.241975 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:40:55.242169 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:40:55.242173 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:40:55.242275 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 14:40:55.242357 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:40:55.242463 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260808 14:40:55.243081 10631 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33149
I20260808 14:40:55.243180 10631 heartbeater.cc:464] Registering TS with master...
I20260808 14:40:55.243337 10631 heartbeater.cc:511] Master 127.29.168.254:33149 requested a full tablet report, sending...
I20260808 14:40:55.243741 9916 ts_manager.cc:194] Registered new tserver with Master: a32687fffed7482fb0972f573c11da4c (127.29.168.195:45525)
I20260808 14:40:55.244086 9916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:39825
I20260808 14:40:55.248947 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab.
Entry for principal oryx/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab.
WARNING: no policy specified for oryx/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab.
Entry for principal oryx/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab.
WARNING: no policy specified for oryx/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab.
Entry for principal oryx/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab.
I20260808 14:40:55.312450 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 10022
I20260808 14:40:55.325109 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 10222
I20260808 14:40:55.342033 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 10424
I20260808 14:40:55.352821 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 9875
I20260808 14:40:55.362139 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33149
--webserver_interface=127.29.168.254
--webserver_port=40903
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:40:55.449095 10650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:55.449316 10650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:55.449354 10650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:55.450449 10650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:40:55.450533 10650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:55.450560 10650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:55.450591 10650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:40:55.450616 10650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:40:55.452106 10650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=40903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:55.452376 10650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:55.452595 10650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:55.457662 10662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.457647 10658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.457938 10650 server_base.cc:1034] running on GCE node
W20260808 14:40:55.457952 10657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.458307 10650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:55.458712 10650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:55.459918 10650 hybrid_clock.cc:648] HybridClock initialized: now 1786200055459904 us; error 29 us; skew 500 ppm
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:55.462913 10650 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:40:55.463341 10650 webserver.cc:460] Webserver started at http://127.29.168.254:40903/ using document root <none> and password file <none>
I20260808 14:40:55.463560 10650 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:55.463640 10650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:55.465165 10650 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:55.465966 10672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.466156 10650 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:55.466259 10650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "b2231dfaa567405aa27e1bbe62249534"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "b10dfaee56730b8b1bfba0cdfaf65415"
server_key_iv: "9c6ce1368795acea8ea6f13c7d28bf67"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.466663 10650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:55.493006 10650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:55.495446 10650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:55.495700 10650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:55.501030 10650 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33149
I20260808 14:40:55.501077 10757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33149 every 8 connection(s)
I20260808 14:40:55.501529 10650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:40:55.503708 10759 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:40:55.504766 10759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Bootstrap starting.
I20260808 14:40:55.509974 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 10650
I20260808 14:40:55.510329 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:40635
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:33149
--webserver_port=42711
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:40:55.514874 10759 log.cc:824] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Log is configured to *not* fsync() on all Append() calls
I20260808 14:40:55.517082 10759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:40:55.517408 10759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Bootstrap complete.
I20260808 14:40:55.521270 10759 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:55.521675 10759 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2231dfaa567405aa27e1bbe62249534, State: Initialized, Role: FOLLOWER
I20260808 14:40:55.521886 10759 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:55.521979 10759 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:40:55.522060 10759 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:40:55.522123 10759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:40:55.523614 10759 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:55.523736 10759 leader_election.cc:302] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2231dfaa567405aa27e1bbe62249534; no voters:
I20260808 14:40:55.523885 10759 leader_election.cc:288] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:40:55.523983 10765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:40:55.524235 10765 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [term 2 LEADER]: Becoming Leader. State: Replica: b2231dfaa567405aa27e1bbe62249534, State: Running, Role: LEADER
I20260808 14:40:55.524241 10759 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:40:55.524477 10765 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } }
I20260808 14:40:55.524986 10766 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b2231dfaa567405aa27e1bbe62249534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } } }
I20260808 14:40:55.525727 10766 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:55.525632 10768 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2231dfaa567405aa27e1bbe62249534. Latest consensus state: current_term: 2 leader_uuid: "b2231dfaa567405aa27e1bbe62249534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2231dfaa567405aa27e1bbe62249534" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33149 } } }
I20260808 14:40:55.526130 10768 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534 [sys.catalog]: This master's current role is: LEADER
I20260808 14:40:55.526286 10788 catalog_manager.cc:1259] Loaded cluster ID: 0b2c2ccabf504f1a84f6940d435699a4
I20260808 14:40:55.526335 10788 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: loading cluster ID for follower catalog manager: success
I20260808 14:40:55.527506 10788 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: acquiring CA information for follower catalog manager: success
I20260808 14:40:55.527933 10788 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:40:55.528035 10789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:40:55.528199 10789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:40:55.528270 10789 catalog_manager.cc:1259] Loaded cluster ID: 0b2c2ccabf504f1a84f6940d435699a4
I20260808 14:40:55.528293 10789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:40:55.528465 10789 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:40:55.528546 10789 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b2231dfaa567405aa27e1bbe62249534: Loaded TSK: 0
I20260808 14:40:55.528663 10789 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:40:55.626694 10761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:55.626884 10761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:55.626907 10761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:55.628072 10761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:55.628108 10761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:55.628131 10761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:40:55.629459 10761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.193.keytab
--principal=oryx/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:40635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=42711
--tserver_master_addrs=127.29.168.254:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:55.629667 10761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:55.629880 10761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:55.634802 10798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.634835 10799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.635110 10802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.635612 10761 server_base.cc:1034] running on GCE node
I20260808 14:40:55.635922 10761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:55.636158 10761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:55.637332 10761 hybrid_clock.cc:648] HybridClock initialized: now 1786200055637321 us; error 29 us; skew 500 ppm
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:55.639986 10761 init.cc:377] Logged in from keytab as oryx/127.29.168.193@KRBTEST.COM (short username oryx)
I20260808 14:40:55.640460 10761 webserver.cc:460] Webserver started at http://127.29.168.193:42711/ using document root <none> and password file <none>
I20260808 14:40:55.640671 10761 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:55.640748 10761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:55.642053 10761 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:40:55.642644 10809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.642855 10761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:40:55.642943 10761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "40b2a03266df45ed80906a7ad7cec891"
format_stamp: "Formatted at 2026-08-08 14:40:54 on dist-test-slave-mjjr"
server_key: "0b708e2ab4bc3e82c7811a1ddfa509b0"
server_key_iv: "67f135db0b2a6996dcc5a89a480c9f89"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.643314 10761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:55.660765 10761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:55.662847 10761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:55.662952 10761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:55.663134 10761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:55.663458 10761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:55.663502 10761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.663525 10761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:55.663575 10761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.669333 10761 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:40635
I20260808 14:40:55.669418 10979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:40635 every 8 connection(s)
I20260808 14:40:55.669734 10761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.676858 10982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.670448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:55927)
0808 14:40:55.670628 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.670670 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.671097 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.671415 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.671418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.671931 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.672095 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.672099 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.673040 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.673041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.673788 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.673789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.674291 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.674292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.674402 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.674780 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.674787 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.676737 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
W20260808 14:40:55.676997 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.670485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:55927 (local address 127.29.168.254:33149)
0808 14:40:55.670688 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.670696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.670751 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:40:55.671244 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.671248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.671286 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.671381 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.672190 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.672960 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.673863 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.674216 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.674311 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.676855 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:55927: BlockingRecv error: recv got EOF from 127.29.168.193:55927 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
W20260808 14:40:55.677083 10980 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:33149 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.168.254:33149: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
I20260808 14:40:55.677386 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 10761
I20260808 14:40:55.677731 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:38073
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:33149
--webserver_port=45135
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.681872 10982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.677329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:40353)
0808 14:40:55.677389 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.677397 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.677430 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.677572 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.677574 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.677713 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.677759 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.677760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.678410 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.678411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.679193 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.679195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.679696 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.679697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.679767 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.680170 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.680174 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.681793 (+ 1619us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:40:55.681900 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.677389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:40353 (local address 127.29.168.254:33149)
0808 14:40:55.677419 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.677421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.677429 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:55.677494 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.677495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.677505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.677553 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.677905 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.678316 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.679296 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.679592 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.679683 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.681867 (+ 2184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:40353: BlockingRecv error: recv got EOF from 127.29.168.193:40353 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.686575 10982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.682123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:59533)
0808 14:40:55.682161 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.682169 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.682199 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.682332 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.682333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.682466 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.682499 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.682500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.683073 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.683074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.683945 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.683947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.684254 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.684255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.684317 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.684674 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.684680 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.686486 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:40:55.686619 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.682173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:59533 (local address 127.29.168.254:33149)
0808 14:40:55.682204 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.682206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.682215 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:55.682248 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.682248 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.682256 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.682309 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.682587 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.683000 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.684022 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.684183 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.684232 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.686566 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:59533: BlockingRecv error: recv got EOF from 127.29.168.193:59533 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 14:40:55.686715 10980 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:40:55.758349 10985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:55.758533 10985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:55.758554 10985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:55.759742 10985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:55.759781 10985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:55.759806 10985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:40:55.761652 10985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.194.keytab
--principal=oryx/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:38073
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=45135
--tserver_master_addrs=127.29.168.254:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:55.761874 10985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:55.762084 10985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:55.766837 10999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.766847 10996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.766899 10995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.766983 10985 server_base.cc:1034] running on GCE node
I20260808 14:40:55.767393 10985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:55.767582 10985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:55.768721 10985 hybrid_clock.cc:648] HybridClock initialized: now 1786200055768715 us; error 36 us; skew 500 ppm
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:55.771080 10985 init.cc:377] Logged in from keytab as oryx/127.29.168.194@KRBTEST.COM (short username oryx)
I20260808 14:40:55.771504 10985 webserver.cc:460] Webserver started at http://127.29.168.194:45135/ using document root <none> and password file <none>
I20260808 14:40:55.771763 10985 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:55.771840 10985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:55.773080 10985 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:55.773587 11008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.773753 10985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:40:55.773861 10985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "586c94b091364dd9bb35def221a162d6"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "75b5bd13931febcef9abdea43820ff79"
server_key_iv: "4511dc7f8c32122966268d180da0a112"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.774173 10985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:55.795125 10985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:55.796887 10985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:55.797045 10985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:55.797254 10985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:55.797554 10985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:55.797612 10985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.797652 10985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:55.797678 10985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.803184 10985 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38073
I20260808 14:40:55.803223 11178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38073 every 8 connection(s)
I20260808 14:40:55.803545 10985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:40:55.804435 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 10985
I20260808 14:40:55.804718 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:45525
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:33149
--webserver_port=38445
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:45139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.811022 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.804252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:49423)
0808 14:40:55.804425 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.804463 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.805024 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.805267 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.805271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.805827 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.805995 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.805999 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.807037 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.807038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.807882 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.807885 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.808366 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.808366 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.808453 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.808905 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.808913 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.810900 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
W20260808 14:40:55.811090 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.804280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:49423 (local address 127.29.168.254:33149)
0808 14:40:55.804381 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.804383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.804566 (+ 183us) server_negotiation.cc:407] Connection header received
0808 14:40:55.805129 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.805130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.805147 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.805201 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.806097 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.806931 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.807967 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.808264 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.808346 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.811011 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:49423: BlockingRecv error: recv got EOF from 127.29.168.194:49423 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 14:40:55.811268 11179 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:33149 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.168.254:33149: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.815996 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.811495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:34905)
0808 14:40:55.811557 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.811566 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.811599 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.811772 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.811773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.811917 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.811970 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.811972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.812570 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.812571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.813417 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.813419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.813724 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.813725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.813793 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.814113 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.814118 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.815956 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:40:55.816130 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.811547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:34905 (local address 127.29.168.254:33149)
0808 14:40:55.811581 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.811582 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.811591 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:40:55.811680 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.811680 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.811689 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.811745 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.812062 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.812474 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.813502 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.813658 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.813699 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.816066 (+ 2367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:34905: BlockingRecv error: recv got EOF from 127.29.168.194:34905 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.820170 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.816459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:60149)
0808 14:40:55.816498 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.816507 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.816566 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.816672 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.816672 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.816796 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.816819 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.816820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.817429 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.817430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.817890 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.817891 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.818236 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.818237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.818289 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.818664 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.818668 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.820105 (+ 1437us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 14:40:55.820212 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.816518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:60149 (local address 127.29.168.254:33149)
0808 14:40:55.816573 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.816575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.816586 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:55.816617 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.816618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.816626 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.816670 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.816899 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.817351 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.817980 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.818168 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.818237 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.820164 (+ 1927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:60149: BlockingRecv error: recv got EOF from 127.29.168.194:60149 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 14:40:55.820427 11179 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:40:55.890431 11183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:40:55.890601 11183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:40:55.890623 11183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:40:55.891619 11183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:40:55.891723 11183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:40:55.891762 11183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:40:55.893076 11183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:45139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/krb5kdc/oryx_127.29.168.195.keytab
--principal=oryx/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:45525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=38445
--tserver_master_addrs=127.29.168.254:33149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:40:55.893239 11183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:40:55.893395 11183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:40:55.898093 11194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.898106 11196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:40:55.898119 11192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:40:55.898304 11183 server_base.cc:1034] running on GCE node
I20260808 14:40:55.898489 11183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:40:55.898692 11183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:40:55.899821 11183 hybrid_clock.cc:648] HybridClock initialized: now 1786200055899804 us; error 32 us; skew 500 ppm
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200055, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:40:55.902042 11183 init.cc:377] Logged in from keytab as oryx/127.29.168.195@KRBTEST.COM (short username oryx)
I20260808 14:40:55.902383 11183 webserver.cc:460] Webserver started at http://127.29.168.195:38445/ using document root <none> and password file <none>
I20260808 14:40:55.902556 11183 fs_manager.cc:359] Metadata directory not provided
I20260808 14:40:55.902603 11183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:40:55.903784 11183 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:40:55.904351 11208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.904518 11183 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.904620 11183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "a32687fffed7482fb0972f573c11da4c"
format_stamp: "Formatted at 2026-08-08 14:40:55 on dist-test-slave-mjjr"
server_key: "a237590bf62d568dfb05cce93f5d1499"
server_key_iv: "e4ebc05e48482778887aac23b2eb92a5"
server_key_version: "encryptionkey@0"
I20260808 14:40:55.904909 11183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:40:55.930449 11183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:40:55.932093 11183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:40:55.932262 11183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:40:55.932482 11183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:40:55.932765 11183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:40:55.932813 11183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.932843 11183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:40:55.932871 11183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:40:55.938696 11183 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45525
I20260808 14:40:55.938742 11404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45525 every 8 connection(s)
I20260808 14:40:55.939033 11183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:40:55.940886 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 11183
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:40:55.947582 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.939766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:44743 (local address 127.29.168.254:33149)
0808 14:40:55.939853 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.939855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.940018 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:40:55.940478 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.940479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.940489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.940535 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.941732 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.942504 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.943940 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.944193 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.944243 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.947521 (+ 3278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:44743: BlockingRecv error: recv got EOF from 127.29.168.195:44743 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:40:55.947698 11409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.939722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:44743)
0808 14:40:55.939893 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.939926 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.940395 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.940594 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.940597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.941346 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.941637 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.941645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.942613 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.942614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.943853 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.943856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.944272 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.944273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.944424 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.944954 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.944962 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.947480 (+ 2518us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
W20260808 14:40:55.947994 11406 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:33149 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.168.254:33149: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
I20260808 14:40:55.949290 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.941417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.29.168.254:33149)
0808 14:40:55.941545 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.941547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.941559 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:40:55.941614 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.941615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.941627 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.941706 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.942413 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.943164 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.944057 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.944283 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.944353 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.945797 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:40:55.945800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:40:55.945801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:40:55.945810 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:40:55.947774 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:55.948210 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:55.948213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:55.948214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:55.948364 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:40:55.948595 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:40:55.948595 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:40:55.948596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:40:55.948864 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:40:55.948999 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 14:40:55.949094 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:40:55.949198 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.952798 11409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.948222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:43645)
0808 14:40:55.948309 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.948321 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.948361 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.948470 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.948471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.948620 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.948675 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.948677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.949489 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.949490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.950258 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.950260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.950579 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.950580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.950640 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.951012 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.951016 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.952756 (+ 1740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 14:40:55.952909 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.948270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:43645 (local address 127.29.168.254:33149)
0808 14:40:55.948319 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.948321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.948354 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:40:55.948407 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.948408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.948418 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.948466 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.948741 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.949400 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.950335 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.950519 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.950571 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.952841 (+ 2270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:43645: BlockingRecv error: recv got EOF from 127.29.168.195:43645 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:55 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:55.957093 11409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:55.953133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:41637)
0808 14:40:55.953183 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:55.953192 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:55.953247 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:55.953374 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:55.953375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:55.953494 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:55.953517 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.953518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.954111 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.954112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.954613 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:55.954615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.954961 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.954962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:55.955012 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.955397 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:55.955401 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:55.956996 (+ 1595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:40:55.957105 10983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:55.953209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:41637 (local address 127.29.168.254:33149)
0808 14:40:55.953269 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:55.953271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:55.953291 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:40:55.953308 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:55.953309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:55.953317 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:55.953369 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:55.953588 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.954028 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.954695 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:55.954888 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:55.954962 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:55.957058 (+ 2096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:41637: BlockingRecv error: recv got EOF from 127.29.168.195:41637 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 14:40:55.957384 11406 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:40:56 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:56 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:56.691331 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:56.687075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:47445)
0808 14:40:56.687215 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:56.687239 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:56.687289 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:56.687421 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:56.687422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:56.687581 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:56.687642 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:56.687679 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.688292 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.688292 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:56.688779 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:56.688780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.689075 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.689076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:56.689114 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:56.689573 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:56.689577 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:56.691267 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
W20260808 14:40:56.691411 11418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:56.687158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:47445 (local address 127.29.168.254:33149)
0808 14:40:56.687301 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:56.687303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:56.687311 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:56.687331 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:56.687331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:56.687341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:56.687401 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:56.687778 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.688230 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.688840 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.689015 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.689062 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:56.691347 (+ 2285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:47445: BlockingRecv error: recv got EOF from 127.29.168.193:47445 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":95,"threads_started":1}
Aug 08 14:40:56 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:56 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:56.825940 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:56.820833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:58659)
0808 14:40:56.821026 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:56.821038 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:56.821102 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:56.821238 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:56.821239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:56.821425 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:56.821480 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:56.821481 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.822144 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.822145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:56.822810 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:56.822812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.823143 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.823144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:56.823200 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:56.823870 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:56.823874 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:56.825873 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":128,"threads_started":1}
W20260808 14:40:56.826036 11418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:56.820973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:58659 (local address 127.29.168.254:33149)
0808 14:40:56.821047 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:56.821049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:56.821085 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:40:56.821148 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:56.821148 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:56.821158 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:56.821214 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:56.821546 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.822053 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.822913 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.823082 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.823130 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:56.825968 (+ 2838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:58659: BlockingRecv error: recv got EOF from 127.29.168.194:58659 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 14:40:56 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:56 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:56.962296 11421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:56.957893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:35155)
0808 14:40:56.958057 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:56.958068 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:56.958134 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:56.958273 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:56.958274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:56.958449 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:56.958500 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:56.958502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.959200 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.959201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:56.959731 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:56.959733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.960040 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.960041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:56.960076 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:56.960463 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:56.960467 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:56.962195 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":82,"threads_started":1}
W20260808 14:40:56.962333 11418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:56.958012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:35155 (local address 127.29.168.254:33149)
0808 14:40:56.958086 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:56.958088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:56.958117 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:40:56.958188 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:56.958188 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:56.958198 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:56.958244 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:56.958572 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.959141 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.959804 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:56.959980 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:56.960029 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:56.962272 (+ 2243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:35155: BlockingRecv error: recv got EOF from 127.29.168.195:35155 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 14:40:57 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:57 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:57.696372 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:57.691830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:59985)
0808 14:40:57.691956 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:57.691970 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:57.692060 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:57.692189 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:57.692189 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:57.692362 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:57.692423 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:57.692425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.693130 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.693131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:57.693661 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:57.693662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.694011 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.694012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:57.694057 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:57.694500 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:57.694505 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:57.696316 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
W20260808 14:40:57.696528 11424 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:57.691891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:59985 (local address 127.29.168.254:33149)
0808 14:40:57.692004 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:57.692006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:57.692033 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:40:57.692121 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:57.692121 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:57.692132 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:57.692184 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:57.692521 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.693046 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.693736 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.693941 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.693991 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:57.696437 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:59985: BlockingRecv error: recv got EOF from 127.29.168.193:59985 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
Aug 08 14:40:57 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:57 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:57.830798 11425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:57.826476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:39489)
0808 14:40:57.826637 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:57.826647 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:57.826704 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:57.826854 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:57.826854 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:57.827017 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:57.827069 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:57.827070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.827766 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.827767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:57.828241 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:57.828243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.828542 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.828543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:57.828580 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:57.829025 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:57.829029 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:57.830746 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
W20260808 14:40:57.830936 11424 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:57.826546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:39489 (local address 127.29.168.254:33149)
0808 14:40:57.826622 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:57.826623 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:57.826706 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:40:57.826767 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:57.826768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:57.826784 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:57.826829 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:57.827130 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.827623 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.828312 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.828483 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.828531 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:57.830859 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:39489: BlockingRecv error: recv got EOF from 127.29.168.194:39489 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 14:40:57 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:57 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:57.967370 11426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:57.962889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:44151)
0808 14:40:57.963032 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:57.963049 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:57.963120 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:57.963295 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:57.963295 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:57.963458 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:57.963513 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:57.963514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.964157 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.964158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:57.964664 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:57.964665 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.965003 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.965004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:57.965043 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:57.965485 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:57.965489 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:57.967307 (+ 1818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
W20260808 14:40:57.967442 11424 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:57.963111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:44151 (local address 127.29.168.254:33149)
0808 14:40:57.963172 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:57.963174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:57.963182 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:40:57.963200 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:57.963201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:57.963211 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:57.963260 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:57.963584 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.964095 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.964744 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:57.964935 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:57.964990 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:57.967395 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:44151: BlockingRecv error: recv got EOF from 127.29.168.195:44151 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 14:40:58 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:58 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:58.701429 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:58.696956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:56761)
0808 14:40:58.697138 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:58.697149 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:58.697204 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:58.697436 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:58.697437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:58.697595 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:58.697665 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:58.697667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.698314 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.698315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:58.698847 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:58.698849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.699165 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.699166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:58.699204 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:58.699609 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:58.699614 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:58.701375 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":102,"threads_started":1}
W20260808 14:40:58.701567 11432 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:58.697046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:56761 (local address 127.29.168.254:33149)
0808 14:40:58.697177 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:58.697179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:58.697190 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:40:58.697310 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:58.697311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:58.697334 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:58.697388 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:58.697731 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.698241 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.698916 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.699094 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.699141 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:58.701466 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:56761: BlockingRecv error: recv got EOF from 127.29.168.193:56761 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
Aug 08 14:40:58 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:58 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:58.835748 11433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:58.831333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:38761)
0808 14:40:58.831524 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:58.831534 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:58.831592 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:58.831743 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:58.831744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:58.831898 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:58.831950 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:58.831951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.832709 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.832710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:58.833187 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:58.833189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.833483 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.833484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:58.833519 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:58.833987 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:58.833991 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:58.835627 (+ 1636us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":124,"threads_started":1}
W20260808 14:40:58.835872 11432 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:58.831385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:38761 (local address 127.29.168.254:33149)
0808 14:40:58.831464 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:58.831466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:58.831593 (+ 127us) server_negotiation.cc:407] Connection header received
0808 14:40:58.831647 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:58.831647 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:58.831670 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:58.831721 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:58.832030 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.832646 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.833254 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.833424 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.833472 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:58.835757 (+ 2285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:38761: BlockingRecv error: recv got EOF from 127.29.168.194:38761 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 14:40:58 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:58 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:58.972450 11434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:58.967914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:38705)
0808 14:40:58.968072 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:58.968095 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:58.968189 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:58.968308 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:58.968309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:58.968485 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:58.968536 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:58.968537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.969211 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.969211 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:58.969714 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:58.969716 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.970018 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.970019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:58.970061 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:58.970576 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:58.970580 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:58.972364 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
W20260808 14:40:58.972666 11432 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:58.967999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:38705 (local address 127.29.168.254:33149)
0808 14:40:58.968073 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:58.968087 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:58.968170 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:40:58.968233 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:58.968234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:58.968246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:58.968290 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:58.968602 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.969141 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.969791 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:58.969963 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:58.970007 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:58.972460 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:38705: BlockingRecv error: recv got EOF from 127.29.168.195:38705 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 14:40:59 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:59 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:59.710237 11435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:59.701996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:56091)
0808 14:40:59.702143 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:59.702153 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:59.702207 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:59.702335 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:59.702336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:59.702526 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:59.702575 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:59.702577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.703166 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.703167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:59.703677 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:59.703680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.703985 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.703986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:59.704031 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:59.708519 (+ 4488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:59.708525 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:59.710182 (+ 1657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
W20260808 14:40:59.710366 11437 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:59.702090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:56091 (local address 127.29.168.254:33149)
0808 14:40:59.702189 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:59.702191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:59.702206 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:40:59.702251 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:59.702252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:59.702261 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:59.702316 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:59.702639 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.703104 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.703750 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.703926 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.703973 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:59.710285 (+ 6312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:56091: BlockingRecv error: recv got EOF from 127.29.168.193:56091 (error 108)
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":50,"threads_started":1}
Aug 08 14:40:59 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:59 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:59.840881 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:59.836198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:50045)
0808 14:40:59.836380 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:59.836391 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:59.836475 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:59.836602 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:59.836602 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:59.836792 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:59.836839 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:59.836841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.837572 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.837573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:59.838098 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:59.838100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.838467 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.838468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:59.838528 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:59.838976 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:59.838981 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:59.840819 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":84,"threads_started":1}
W20260808 14:40:59.840989 11437 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:59.836280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:50045 (local address 127.29.168.254:33149)
0808 14:40:59.836363 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:59.836365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:59.836456 (+ 91us) server_negotiation.cc:407] Connection header received
0808 14:40:59.836536 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:59.836537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:59.836550 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:59.836599 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:59.836956 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.837478 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.838189 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.838380 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.838463 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:59.840900 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:50045: BlockingRecv error: recv got EOF from 127.29.168.194:50045 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 14:40:59 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:40:59 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:40:59.977401 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:40:59.972982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:35201)
0808 14:40:59.973122 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:40:59.973135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:40:59.973205 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:40:59.973332 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:40:59.973333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:40:59.973496 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:40:59.973559 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:59.973561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.974159 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.974160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:59.974639 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:40:59.974640 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.974971 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.974972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:40:59.975011 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:59.975502 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:40:59.975507 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:40:59.977344 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
W20260808 14:40:59.977550 11437 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:40:59.973079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:35201 (local address 127.29.168.254:33149)
0808 14:40:59.973149 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:40:59.973150 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:40:59.973201 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:40:59.973247 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:40:59.973247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:40:59.973262 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:40:59.973313 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:40:59.973618 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.974098 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.974728 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:40:59.974908 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:40:59.974957 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:40:59.977483 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:35201: BlockingRecv error: recv got EOF from 127.29.168.195:35201 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:41:00 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:00 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:00.715022 11444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:00.710662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:53333)
0808 14:41:00.710789 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:00.710797 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:00.710841 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:00.710975 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:00.710976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:00.711122 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:00.711172 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:00.711174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.711846 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.711847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:00.712398 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:00.712400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.712770 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.712771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:00.712812 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:00.713224 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:00.713229 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:00.714965 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
W20260808 14:41:00.715139 11445 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:00.710700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:53333 (local address 127.29.168.254:33149)
0808 14:41:00.710823 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:00.710825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:00.710834 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:41:00.710900 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:00.710901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:00.710910 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:00.710958 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:00.711231 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.711763 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.712497 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.712705 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.712757 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:00.715056 (+ 2299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:53333: BlockingRecv error: recv got EOF from 127.29.168.193:53333 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
Aug 08 14:41:00 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:00 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:00.845376 11446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:00.841275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:37215)
0808 14:41:00.841404 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:00.841413 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:00.841453 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:00.841577 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:00.841577 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:00.841722 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:00.841770 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:00.841771 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.842359 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.842360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:00.842827 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:00.842828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.843127 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.843128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:00.843165 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:00.843583 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:00.843587 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:00.845308 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
W20260808 14:41:00.845512 11445 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:00.841394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:37215 (local address 127.29.168.254:33149)
0808 14:41:00.841460 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:00.841462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:00.841469 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:41:00.841493 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:00.841494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:00.841504 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:00.841571 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:00.841823 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.842269 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.842893 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.843064 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.843117 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:00.845425 (+ 2308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:37215: BlockingRecv error: recv got EOF from 127.29.168.194:37215 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 14:41:00 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:00 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:00.982187 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:00.977844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:45977)
0808 14:41:00.978040 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:00.978049 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:00.978140 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:00.978299 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:00.978299 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:00.978475 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:00.978524 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:00.978526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.979149 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.979150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:00.979626 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:00.979627 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.979994 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.979995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:00.980069 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:00.980482 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:00.980487 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:00.982101 (+ 1614us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":124,"threads_started":1}
W20260808 14:41:00.982234 11445 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:00.977889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:45977 (local address 127.29.168.254:33149)
0808 14:41:00.977959 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:00.977961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:00.978121 (+ 160us) server_negotiation.cc:407] Connection header received
0808 14:41:00.978211 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:00.978212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:00.978225 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:00.978292 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:00.978603 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.979065 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.979726 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:00.979911 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:00.979993 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:00.982176 (+ 2183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:45977: BlockingRecv error: recv got EOF from 127.29.168.195:45977 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 14:41:01 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:01 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:01.719831 11448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:01.715540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:55743)
0808 14:41:01.715699 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:01.715711 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:01.715782 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:01.715914 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:01.715914 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:01.716082 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:01.716143 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:01.716144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.716720 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.716720 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:01.717197 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:01.717198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.717494 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.717495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:01.717534 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:01.717939 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:01.717943 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:01.719739 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
W20260808 14:41:01.719931 11450 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:01.715602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:55743 (local address 127.29.168.254:33149)
0808 14:41:01.715790 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:01.715792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:01.715800 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:41:01.715822 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:01.715823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:01.715833 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:01.715893 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:01.716200 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.716662 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.717257 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.717436 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.717483 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:01.719857 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:55743: BlockingRecv error: recv got EOF from 127.29.168.193:55743 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":112,"threads_started":1}
Aug 08 14:41:01 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:01 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:01.850719 11451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:01.845886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:48297)
0808 14:41:01.846090 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:01.846102 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:01.846186 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:01.846332 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:01.846333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:01.846594 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:01.846652 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:01.846654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.847364 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.847365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:01.848005 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:01.848006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.848374 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.848375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:01.848430 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:01.848876 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:01.848880 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:01.850630 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":97,"threads_started":1}
W20260808 14:41:01.850765 11450 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:01.845982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:48297 (local address 127.29.168.254:33149)
0808 14:41:01.846086 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:01.846088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:01.846167 (+ 79us) server_negotiation.cc:407] Connection header received
0808 14:41:01.846247 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:01.846248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:01.846259 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:01.846346 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:01.846729 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.847278 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.848085 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.848287 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.848373 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:01.850706 (+ 2333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:48297: BlockingRecv error: recv got EOF from 127.29.168.194:48297 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 14:41:01 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:01 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:01.987442 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:01.982722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:45091)
0808 14:41:01.982881 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:01.982891 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:01.982954 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:01.983089 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:01.983089 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:01.983238 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:01.983284 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:01.983285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.983925 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.983926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:01.984426 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:01.984427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.984839 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.984840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:01.984879 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:01.985320 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:01.985330 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:01.987342 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
W20260808 14:41:01.987615 11450 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:01.982819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:45091 (local address 127.29.168.254:33149)
0808 14:41:01.982898 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:01.982900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:01.982944 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:41:01.983005 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:01.983005 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:01.983016 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:01.983075 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:01.983345 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.983859 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.984524 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:01.984746 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:01.984823 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:01.987489 (+ 2666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:45091: BlockingRecv error: recv got EOF from 127.29.168.195:45091 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 14:41:02 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:02 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:02.724911 11454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:02.720252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:56739)
0808 14:41:02.720437 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:02.720448 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:02.720512 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:02.720675 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:02.720676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:02.720878 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:02.720931 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:02.720933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.721565 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.721565 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:02.722104 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:02.722106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.722457 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.722458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:02.722497 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:02.723000 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:02.723005 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:02.724848 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":98,"threads_started":1}
W20260808 14:41:02.725118 11455 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:02.720334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:56739 (local address 127.29.168.254:33149)
0808 14:41:02.720444 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:02.720446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:02.720506 (+ 60us) server_negotiation.cc:407] Connection header received
0808 14:41:02.720584 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:02.720584 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:02.720594 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:02.720653 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:02.720993 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.721496 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.722174 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.722382 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.722439 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:02.724985 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:56739: BlockingRecv error: recv got EOF from 127.29.168.193:56739 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":57,"threads_started":1}
Aug 08 14:41:02 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:02 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:02.855751 11456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:02.851191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:46715)
0808 14:41:02.851372 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:02.851387 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:02.851461 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:02.851581 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:02.851582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:02.851781 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:02.851829 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:02.851831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.852454 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.852455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:02.852955 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:02.852956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.853308 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.853309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:02.853377 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:02.853833 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:02.853838 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:02.855681 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
W20260808 14:41:02.855947 11455 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:02.851267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:46715 (local address 127.29.168.254:33149)
0808 14:41:02.851346 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:02.851348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:02.851441 (+ 93us) server_negotiation.cc:407] Connection header received
0808 14:41:02.851517 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:02.851518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:02.851529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:02.851578 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:02.851902 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.852362 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.853056 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.853239 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.853309 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:02.855891 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:46715: BlockingRecv error: recv got EOF from 127.29.168.194:46715 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 14:41:02 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:02 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:02.991988 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:02.987876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:34083)
0808 14:41:02.988020 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:02.988030 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:02.988088 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:02.988202 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:02.988203 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:02.988365 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:02.988415 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:02.988416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.989023 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.989024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:02.989506 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:02.989507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.989817 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.989817 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:02.989868 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:02.990287 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:02.990291 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:02.991931 (+ 1640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
W20260808 14:41:02.992097 11455 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:02.987948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:34083 (local address 127.29.168.254:33149)
0808 14:41:02.988024 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:02.988027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:02.988088 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:41:02.988129 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:02.988129 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:02.988141 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:02.988191 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:02.988473 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.988961 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.989572 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:02.989742 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:02.989803 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:02.992017 (+ 2214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:34083: BlockingRecv error: recv got EOF from 127.29.168.195:34083 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 14:41:03 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:03 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:03.730589 11458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:03.725705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:48009)
0808 14:41:03.725906 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:03.725919 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:03.725998 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:03.726266 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:03.726268 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:03.726520 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:03.726595 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:03.726597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.727293 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.727294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:03.727858 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:03.727860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.728184 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.728184 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:03.728224 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:03.728764 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:03.728769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:03.730520 (+ 1751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":125,"threads_started":1}
W20260808 14:41:03.730664 11459 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:03.725810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:48009 (local address 127.29.168.254:33149)
0808 14:41:03.725993 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:03.725996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:03.726010 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:41:03.726075 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:03.726076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:03.726089 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:03.726201 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:03.726694 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.727209 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.727931 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.728129 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.728172 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:03.730613 (+ 2441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:48009: BlockingRecv error: recv got EOF from 127.29.168.193:48009 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":88,"threads_started":1}
Aug 08 14:41:03 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:03 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:03.860584 11460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:03.856213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:37181)
0808 14:41:03.856365 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:03.856374 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:03.856425 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:03.856594 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:03.856595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:03.856748 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:03.856817 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:03.856818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.857546 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.857546 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:03.858072 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:03.858073 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.858378 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.858379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:03.858417 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:03.858874 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:03.858879 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:03.860531 (+ 1652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":94,"threads_started":1}
W20260808 14:41:03.860711 11459 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:03.856297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:37181 (local address 127.29.168.254:33149)
0808 14:41:03.856365 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:03.856366 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:03.856426 (+ 60us) server_negotiation.cc:407] Connection header received
0808 14:41:03.856468 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:03.856468 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:03.856478 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:03.856545 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:03.856877 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.857471 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.858150 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.858313 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.858365 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:03.860640 (+ 2275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:37181: BlockingRecv error: recv got EOF from 127.29.168.194:37181 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 14:41:03 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:03 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:03.997146 11461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:03.992586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:59843)
0808 14:41:03.992770 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:03.992780 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:03.992839 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:03.992987 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:03.992988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:03.993164 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:03.993212 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:03.993214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.993810 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.993811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:03.994318 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:03.994320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.994650 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.994671 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:03.994733 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:03.995241 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:03.995247 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:03.997090 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":88,"threads_started":1}
W20260808 14:41:03.997299 11459 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:03.992639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:59843 (local address 127.29.168.254:33149)
0808 14:41:03.992685 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:03.992687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:03.992840 (+ 153us) server_negotiation.cc:407] Connection header received
0808 14:41:03.992878 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:03.992878 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:03.992891 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:03.992969 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:03.993271 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.993751 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.994382 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:03.994541 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:03.994638 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:03.997212 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:59843: BlockingRecv error: recv got EOF from 127.29.168.195:59843 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 08 14:41:04 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:04 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:04.740253 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:04.731118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:45175)
0808 14:41:04.731240 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:04.731253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:04.731320 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:04.731507 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:04.731508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:04.731769 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:04.731842 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:04.731845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.732762 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.732763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:04.733573 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:04.733576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.734041 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.734043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:04.734116 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:04.738168 (+ 4052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:04.738172 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:04.740185 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
W20260808 14:41:04.740396 11469 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:04.731175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:45175 (local address 127.29.168.254:33149)
0808 14:41:04.731283 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:04.731285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:04.731299 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:41:04.731404 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:04.731405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:04.731418 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:04.731485 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:04.731926 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.732671 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.733660 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.733959 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.734021 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:04.740280 (+ 6259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:45175: BlockingRecv error: recv got EOF from 127.29.168.193:45175 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":48,"threads_started":1}
Aug 08 14:41:04 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:04 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:04.865993 11470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:04.861000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:51931)
0808 14:41:04.861176 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:04.861190 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:04.861269 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:04.861422 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:04.861423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:04.861626 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:04.861672 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:04.861673 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.862288 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.862290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:04.862825 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:04.862826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.863160 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.863161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:04.863218 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:04.863712 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:04.863717 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:04.865885 (+ 2168us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":89,"threads_started":1}
W20260808 14:41:04.866042 11469 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:04.861058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:51931 (local address 127.29.168.254:33149)
0808 14:41:04.861130 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:04.861132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:04.861241 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:41:04.861329 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:04.861330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:04.861347 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:04.861402 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:04.861742 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.862207 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.862905 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.863091 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.863161 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:04.865973 (+ 2812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:51931: BlockingRecv error: recv got EOF from 127.29.168.194:51931 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 14:41:04 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:04 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:05.002164 11471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:04.997671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:43653)
0808 14:41:04.997850 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:04.997862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:04.997928 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:04.998060 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:04.998061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:04.998239 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:04.998300 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:04.998301 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.998966 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.998966 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:04.999466 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:04.999467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.999789 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.999790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:04.999826 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:05.000344 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:05.000349 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:05.002096 (+ 1747us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
W20260808 14:41:05.002298 11469 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:04.997767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:43653 (local address 127.29.168.254:33149)
0808 14:41:04.997829 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:04.997831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:04.997928 (+ 97us) server_negotiation.cc:407] Connection header received
0808 14:41:04.997972 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:04.997973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:04.997985 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:04.998036 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:04.998387 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.998884 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.999532 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:04.999725 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:04.999772 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:05.002218 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:43653: BlockingRecv error: recv got EOF from 127.29.168.195:43653 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 14:41:05 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:05 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:05.745050 11472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:05.740687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:41637)
0808 14:41:05.740856 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:05.740865 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:05.740915 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:05.741046 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:05.741046 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:05.741213 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:05.741264 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:05.741265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.741869 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.741869 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:05.742380 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:05.742382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.742747 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.742748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:05.742803 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:05.743222 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:05.743226 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:05.744986 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
W20260808 14:41:05.745219 11474 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:05.740744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:41637 (local address 127.29.168.254:33149)
0808 14:41:05.740929 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:05.740931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:05.740939 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:41:05.740959 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:05.740960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:05.740970 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:05.741028 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:05.741327 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.741808 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.742502 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.742685 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.742734 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:05.745110 (+ 2376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:41637: BlockingRecv error: recv got EOF from 127.29.168.193:41637 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":123,"threads_started":1}
Aug 08 14:41:05 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:05 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:05.872861 11475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:05.866434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:48327)
0808 14:41:05.866600 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:05.866678 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:05.866747 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:05.866938 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:05.866940 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:05.867219 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:05.867297 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:05.867300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.868564 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.868566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:05.869484 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:05.869488 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.870052 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.870053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:05.870123 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:05.870559 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:05.870579 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:05.872762 (+ 2183us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":102,"threads_started":1}
W20260808 14:41:05.872908 11474 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:05.866636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:48327 (local address 127.29.168.254:33149)
0808 14:41:05.866716 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:05.866718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:05.866726 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:41:05.866808 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:05.866809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:05.866821 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:05.866882 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:05.867519 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.868480 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.869601 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:05.869962 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:05.870022 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:05.872848 (+ 2826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:48327: BlockingRecv error: recv got EOF from 127.29.168.194:48327 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 08 14:41:06 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:06 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:06.007426 11476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:06.002646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:47271)
0808 14:41:06.002817 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:06.002855 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:06.002915 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:06.003059 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:06.003060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:06.003222 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:06.003269 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:06.003271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.003938 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.003938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:06.004436 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:06.004437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.004852 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.004854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:06.004932 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:06.005491 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:06.005496 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:06.007367 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
W20260808 14:41:06.007532 11474 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:06.002792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:47271 (local address 127.29.168.254:33149)
0808 14:41:06.002857 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:06.002859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:06.002900 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:41:06.002970 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:06.002971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:06.002983 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:06.003029 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:06.003332 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.003869 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.004526 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.004693 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.004773 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:06.007460 (+ 2687us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:47271: BlockingRecv error: recv got EOF from 127.29.168.195:47271 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 14:41:06 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:06 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:06.750280 11477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:06.745587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:36761)
0808 14:41:06.745755 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:06.745768 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:06.745838 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:06.746018 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:06.746019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:06.746189 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:06.746238 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:06.746240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.746944 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.746945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:06.747485 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:06.747487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.747912 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.747913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:06.747962 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:06.748427 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:06.748432 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:06.750205 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
W20260808 14:41:06.750368 11478 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:06.745661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:36761 (local address 127.29.168.254:33149)
0808 14:41:06.745776 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:06.745778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:06.745818 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:41:06.745907 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:06.745908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:06.745922 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:06.745994 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:06.746302 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.746877 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.747552 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.747826 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.747905 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:06.750294 (+ 2389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:36761: BlockingRecv error: recv got EOF from 127.29.168.193:36761 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":52,"threads_started":1}
Aug 08 14:41:06 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:06 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:06.878245 11479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:06.873619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:47337)
0808 14:41:06.873774 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:06.873785 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:06.873855 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:06.874003 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:06.874004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:06.874183 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:06.874229 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:06.874231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.874892 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.874893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:06.875457 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:06.875459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.875890 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.875891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:06.875955 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:06.876442 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:06.876447 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:06.878137 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
W20260808 14:41:06.878315 11478 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:06.873687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:47337 (local address 127.29.168.254:33149)
0808 14:41:06.873749 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:06.873751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:06.873870 (+ 119us) server_negotiation.cc:407] Connection header received
0808 14:41:06.873914 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:06.873915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:06.873927 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:06.873997 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:06.874313 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.874795 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.875546 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:06.875808 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:06.875892 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:06.878231 (+ 2339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:47337: BlockingRecv error: recv got EOF from 127.29.168.194:47337 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 14:41:07 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:07 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:07.012619 11482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:07.007918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:38763)
0808 14:41:07.008079 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:07.008092 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:07.008163 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:07.008329 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:07.008330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:07.008527 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:07.008572 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:07.008575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.009196 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.009197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:07.009694 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:07.009695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.010051 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.010052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:07.010113 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:07.010520 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:07.010525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:07.012480 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
W20260808 14:41:07.012643 11478 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:07.008012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:38763 (local address 127.29.168.254:33149)
0808 14:41:07.008083 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:07.008085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:07.008143 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:41:07.008227 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:07.008228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:07.008242 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:07.008320 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:07.008652 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.009116 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.009795 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.009977 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.010052 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:07.012575 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:38763: BlockingRecv error: recv got EOF from 127.29.168.195:38763 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 14:41:07 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:07 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:07.755340 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:07.750859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:43351)
0808 14:41:07.751024 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:07.751034 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:07.751081 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:07.751228 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:07.751229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:07.751407 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:07.751454 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:07.751456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.752054 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.752055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:07.752568 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:07.752570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.752863 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.752864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:07.752907 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:07.753386 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:07.753390 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:07.755245 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
W20260808 14:41:07.755432 11485 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:07.750935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:43351 (local address 127.29.168.254:33149)
0808 14:41:07.751058 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:07.751060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:07.751069 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:41:07.751138 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:07.751139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:07.751148 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:07.751208 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:07.751515 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.751991 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.752636 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.752805 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.752849 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:07.755316 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:43351: BlockingRecv error: recv got EOF from 127.29.168.193:43351 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
Aug 08 14:41:07 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:07 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:07.883083 11486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:07.878763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:39481)
0808 14:41:07.878888 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:07.878898 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:07.878950 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:07.879067 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:07.879067 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:07.879222 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:07.879278 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:07.879279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.879935 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.879936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:07.880421 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:07.880422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.880706 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.880706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:07.880743 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:07.881147 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:07.881151 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:07.883025 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
W20260808 14:41:07.883180 11485 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:07.878815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:39481 (local address 127.29.168.254:33149)
0808 14:41:07.878881 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:07.878883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:07.878952 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:41:07.878992 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:07.878993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:07.879003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:07.879052 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:07.879342 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.879862 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.880484 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:07.880649 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:07.880695 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:07.883113 (+ 2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:39481: BlockingRecv error: recv got EOF from 127.29.168.194:39481 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 14:41:08 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:08 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:08.017664 11487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:08.013162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:43053)
0808 14:41:08.013331 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:08.013341 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:08.013400 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:08.013512 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:08.013512 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:08.013676 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:08.013722 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:08.013723 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.014348 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.014348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:08.014875 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:08.014876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.015205 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.015205 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:08.015244 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:08.015799 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:08.015803 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:08.017559 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
W20260808 14:41:08.017694 11485 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:08.013222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:43053 (local address 127.29.168.254:33149)
0808 14:41:08.013290 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:08.013292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:08.013403 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:41:08.013443 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:08.013443 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:08.013455 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:08.013499 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:08.013786 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.014282 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.014974 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.015143 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.015190 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:08.017631 (+ 2441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:43053: BlockingRecv error: recv got EOF from 127.29.168.195:43053 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 14:41:08 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:08 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:08.760700 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:08.755913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:33699)
0808 14:41:08.756050 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:08.756062 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:08.756138 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:08.756295 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:08.756296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:08.756475 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:08.756524 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:08.756526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.757178 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.757178 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:08.757696 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:08.757697 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.758015 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.758016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:08.758057 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:08.758552 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:08.758557 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:08.760585 (+ 2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
W20260808 14:41:08.760740 11492 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:08.755996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:33699 (local address 127.29.168.254:33149)
0808 14:41:08.756144 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:08.756147 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:08.756159 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:41:08.756198 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:08.756198 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:08.756210 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:08.756276 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:08.756596 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.757109 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.757769 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.757952 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.758006 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:08.760666 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:33699: BlockingRecv error: recv got EOF from 127.29.168.193:33699 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
Aug 08 14:41:08 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:08 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:08.888321 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:08.883653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:34211)
0808 14:41:08.883801 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:08.883814 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:08.883894 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:08.884060 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:08.884061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:08.884247 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:08.884295 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:08.884296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.884944 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.884945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:08.885437 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:08.885438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.885837 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.885838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:08.885895 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:08.886401 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:08.886407 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:08.888237 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":66,"threads_started":1}
W20260808 14:41:08.888394 11492 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:08.883777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:34211 (local address 127.29.168.254:33149)
0808 14:41:08.883825 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:08.883827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:08.883875 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:41:08.883976 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:08.883977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:08.883987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:08.884050 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:08.884383 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.884860 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.885553 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:08.885753 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:08.885833 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:08.888333 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:34211: BlockingRecv error: recv got EOF from 127.29.168.194:34211 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 14:41:09 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:09 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:09.022578 11494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:09.018184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:39045)
0808 14:41:09.018369 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:09.018382 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:09.018469 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:09.018651 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:09.018652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:09.018836 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:09.018883 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:09.018885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.019484 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.019485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:09.020057 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:09.020059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.020353 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.020353 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:09.020393 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:09.020839 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:09.020844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:09.022523 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
W20260808 14:41:09.022678 11492 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:09.018265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:39045 (local address 127.29.168.254:33149)
0808 14:41:09.018336 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:09.018338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:09.018470 (+ 132us) server_negotiation.cc:407] Connection header received
0808 14:41:09.018548 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:09.018549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:09.018564 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:09.018625 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:09.018949 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.019418 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.020122 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.020290 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.020340 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:09.022610 (+ 2270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:39045: BlockingRecv error: recv got EOF from 127.29.168.195:39045 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 14:41:09 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:09 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:09.768599 11495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:09.761304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:51679)
0808 14:41:09.761472 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:09.761482 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:09.761540 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:09.761667 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:09.761668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:09.761856 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:09.761924 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:09.761925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.762491 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.762491 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:09.762949 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:09.762950 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.763282 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.763283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:09.763321 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:09.766633 (+ 3312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:09.766639 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:09.768507 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
W20260808 14:41:09.768654 11497 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:09.761354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:51679 (local address 127.29.168.254:33149)
0808 14:41:09.761500 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:09.761502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:09.761525 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:41:09.761590 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:09.761591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:09.761600 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:09.761648 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:09.761987 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.762434 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.763029 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.763208 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.763269 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:09.768588 (+ 5319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:51679: BlockingRecv error: recv got EOF from 127.29.168.193:51679 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
Aug 08 14:41:09 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:09 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:09.893002 11498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:09.888756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:51681)
0808 14:41:09.888895 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:09.888911 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:09.888968 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:09.889079 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:09.889080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:09.889235 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:09.889281 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:09.889283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.889876 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.889876 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:09.890386 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:09.890387 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.890671 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.890672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:09.890721 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:09.891154 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:09.891158 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:09.892936 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
W20260808 14:41:09.893169 11497 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:09.888812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:51681 (local address 127.29.168.254:33149)
0808 14:41:09.888894 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:09.888896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:09.888965 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:41:09.889011 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:09.889011 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:09.889021 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:09.889074 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:09.889342 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.889809 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.890447 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:09.890614 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:09.890659 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:09.893096 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:51681: BlockingRecv error: recv got EOF from 127.29.168.194:51681 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 14:41:10 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:10 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.195@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:10.028084 11499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:10.023040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.195:57707)
0808 14:41:10.023200 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:10.023215 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:10.023276 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:10.023406 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:10.023406 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:10.023598 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:10.023646 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:10.023648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.024377 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.024378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:10.024981 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:10.024984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.025395 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.025396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:10.025458 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:10.026107 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:10.026112 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:10.027988 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":111,"threads_started":1}
W20260808 14:41:10.028122 11497 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:10.023100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:57707 (local address 127.29.168.254:33149)
0808 14:41:10.023167 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:10.023169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:10.023276 (+ 107us) server_negotiation.cc:407] Connection header received
0808 14:41:10.023319 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:10.023320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:10.023340 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:10.023387 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:10.023763 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.024292 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.025093 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.025312 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.025393 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:10.028061 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.195:57707: BlockingRecv error: recv got EOF from 127.29.168.195:57707 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 14:41:10 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:10 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.193@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:10.774104 11500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:10.769206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.193:43419)
0808 14:41:10.769369 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:10.769381 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:10.769454 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:10.769571 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:10.769571 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:10.769734 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:10.769786 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:10.769788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.770484 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.770489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:10.771048 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:10.771049 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.771377 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.771377 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:10.771418 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:10.771856 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:10.771860 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:10.774037 (+ 2177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":78,"threads_started":1}
W20260808 14:41:10.774204 11501 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:10.769276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:43419 (local address 127.29.168.254:33149)
0808 14:41:10.769387 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:10.769391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:10.769442 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:41:10.769496 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:10.769497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:10.769507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:10.769567 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:10.769847 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.770391 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.771119 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.771312 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.771365 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:10.774129 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.193:43419: BlockingRecv error: recv got EOF from 127.29.168.193:43419 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":52,"threads_started":1}
Aug 08 14:41:10 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:41:10 dist-test-slave-mjjr krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.168.194@KRBTEST.COM for oryx/127.29.168.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:41:10.898383 11502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:10.893449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33149 (local address 127.29.168.194:48851)
0808 14:41:10.893620 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:10.893631 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:10.893715 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:10.893877 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:10.893878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:10.894055 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:10.894102 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:10.894104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.894756 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.894758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:10.895336 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:10.895337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.895788 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.895789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:10.895877 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:10.896505 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:10.896510 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:10.898284 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.168.254:33149: Server oryx/127.29.168.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
W20260808 14:41:10.898420 11501 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:10.893634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:48851 (local address 127.29.168.254:33149)
0808 14:41:10.893721 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:10.893723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:10.893740 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:41:10.893774 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:10.893778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:10.893788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:10.893859 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:10.894177 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.894663 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.895441 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:10.895692 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:10.895770 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:10.898361 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.168.194:48851: BlockingRecv error: recv got EOF from 127.29.168.194:48851 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:41:10.949092 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 10761
I20260808 14:41:10.960219 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 10985
I20260808 14:41:10.969061 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 11183
I20260808 14:41:10.975704 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 10650
2026-08-08T14:41:10Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17663 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T14:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:41:11Z Disabled control of system clock
I20260808 14:41:11.007990 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36933
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:41507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:41:11.086380 11511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.086580 11511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.086599 11511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.087723 11511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:41:11.087757 11511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.087769 11511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.087781 11511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:41:11.087793 11511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:41:11.089026 11511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:36933
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.089205 11511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.089421 11511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.094008 11524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.094038 11527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.094135 11511 server_base.cc:1034] running on GCE node
W20260808 14:41:11.094054 11532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.094425 11511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.094725 11511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.095930 11511 hybrid_clock.cc:648] HybridClock initialized: now 1786200071095927 us; error 39 us; skew 500 ppm
I20260808 14:41:11.097070 11511 webserver.cc:460] Webserver started at http://127.29.168.254:45863/ using document root <none> and password file <none>
I20260808 14:41:11.097328 11511 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.097401 11511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.097544 11511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.098492 11511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "02fa42b651ee1af4fc5ba8bb61372c85"
server_key_iv: "f0a540e9c37cfac56e4ee1a8d537141d"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.098834 11511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "02fa42b651ee1af4fc5ba8bb61372c85"
server_key_iv: "f0a540e9c37cfac56e4ee1a8d537141d"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.100179 11511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:41:11.100864 11543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.101032 11511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:41:11.101128 11511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "02fa42b651ee1af4fc5ba8bb61372c85"
server_key_iv: "f0a540e9c37cfac56e4ee1a8d537141d"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.101202 11511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.108989 11511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.109249 11511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.109397 11511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.113305 11511 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:36933
I20260808 14:41:11.113422 11631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:36933 every 8 connection(s)
I20260808 14:41:11.113682 11511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:41:11.114383 11633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:11.116770 11633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d: Bootstrap starting.
I20260808 14:41:11.117280 11633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:11.117513 11633 log.cc:824] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:11.118091 11633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d: No bootstrap required, opened a new log
I20260808 14:41:11.119395 11633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36933 } }
I20260808 14:41:11.119504 11633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:11.119524 11633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0998ac9aed3b4d1c9ea406ca1d59c10d, State: Initialized, Role: FOLLOWER
I20260808 14:41:11.119640 11633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36933 } }
I20260808 14:41:11.119731 11633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:41:11.119756 11633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:41:11.119781 11633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:11.120196 11633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36933 } }
I20260808 14:41:11.120278 11633 leader_election.cc:302] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0998ac9aed3b4d1c9ea406ca1d59c10d; no voters:
I20260808 14:41:11.120411 11633 leader_election.cc:288] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:41:11.120443 11637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:41:11.120570 11637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [term 1 LEADER]: Becoming Leader. State: Replica: 0998ac9aed3b4d1c9ea406ca1d59c10d, State: Running, Role: LEADER
I20260808 14:41:11.120648 11633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:41:11.120741 11637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36933 } }
I20260808 14:41:11.121161 11639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36933 } } }
I20260808 14:41:11.121254 11639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:11.121268 11640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0998ac9aed3b4d1c9ea406ca1d59c10d. Latest consensus state: current_term: 1 leader_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0998ac9aed3b4d1c9ea406ca1d59c10d" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36933 } } }
I20260808 14:41:11.121316 11640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:11.121451 11655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:41:11.121954 11655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:41:11.122407 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 11511
I20260808 14:41:11.122484 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:41:11.122671 30371 external_mini_cluster.cc:1428] Setting key 28d0689c7bc430ded67182914b1d06af
I20260808 14:41:11.123777 11655 catalog_manager.cc:1347] Generated new cluster ID: ccdc3e67f32c4405befc787b16f8743c
I20260808 14:41:11.123831 11655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:41:11.128679 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.123092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56658 (local address 127.29.168.254:36933)
0808 14:41:11.123278 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.123285 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.123437 (+ 152us) server_negotiation.cc:407] Connection header received
0808 14:41:11.123549 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.123555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.123632 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.123795 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.124109 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.125387 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.126542 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.127121 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.127224 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.127942 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.127946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.127946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.128138 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.128172 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.128184 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.128240 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.128344 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.128497 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260808 14:41:11.140244 11655 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:41:11.140882 11655 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:41:11.148962 11655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0998ac9aed3b4d1c9ea406ca1d59c10d: Generated new TSK 0
I20260808 14:41:11.149113 11655 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:41:11.154291 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36933
--builtin_ntp_servers=127.29.168.212:41507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:41:11.234190 11674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.234400 11674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.234432 11674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.235461 11674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.235523 11674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.235581 11674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:41:11.236958 11674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.237200 11674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.237468 11674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.242854 11684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.242913 11686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.242836 11683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.243039 11674 server_base.cc:1034] running on GCE node
I20260808 14:41:11.243203 11674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.243414 11674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.244547 11674 hybrid_clock.cc:648] HybridClock initialized: now 1786200071244537 us; error 24 us; skew 500 ppm
I20260808 14:41:11.245628 11674 webserver.cc:460] Webserver started at http://127.29.168.193:44167/ using document root <none> and password file <none>
I20260808 14:41:11.245903 11674 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.245975 11674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.246120 11674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.247133 11674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "588008573cf24d4a888f8d97d27570dc"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "9e496818cd0ee9e26a765f838544c615"
server_key_iv: "87a035390576496631c08be66d65ccc4"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.247493 11674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "588008573cf24d4a888f8d97d27570dc"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "9e496818cd0ee9e26a765f838544c615"
server_key_iv: "87a035390576496631c08be66d65ccc4"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.248724 11674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:41:11.249383 11697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.249544 11674 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:41:11.249631 11674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "588008573cf24d4a888f8d97d27570dc"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "9e496818cd0ee9e26a765f838544c615"
server_key_iv: "87a035390576496631c08be66d65ccc4"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.249706 11674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.264082 11674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.264410 11674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.264568 11674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.264770 11674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:11.265110 11674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:11.265162 11674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.265194 11674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:11.265223 11674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.270749 11674 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:37053
I20260808 14:41:11.270829 11867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:37053 every 8 connection(s)
I20260808 14:41:11.271126 11674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:41:11.276000 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.271794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:50001 (local address 127.29.168.254:36933)
0808 14:41:11.271853 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.271855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.272086 (+ 231us) server_negotiation.cc:407] Connection header received
0808 14:41:11.272597 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.272598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.272612 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.272659 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.273243 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.273710 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.274613 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.274827 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.274908 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.275587 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.275589 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.275589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.275594 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.275606 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.275610 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.275795 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.275891 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.275921 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:41:11.276202 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.271789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:36933 (local address 127.29.168.193:50001)
0808 14:41:11.271981 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:11.272010 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:11.272492 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:11.272720 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:11.272724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:11.272733 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:11.273155 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:11.273159 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.273803 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.273804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:11.274521 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:11.274523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.274920 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.274920 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:11.275045 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.275449 (+ 404us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:41:11.275449 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:11.275473 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:41:11.275493 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:11.275796 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:11.275804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:11.275807 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:41:11.275892 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:41:11.275989 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260808 14:41:11.276671 11870 heartbeater.cc:347] Connected to a master server at 127.29.168.254:36933
I20260808 14:41:11.276748 11870 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:11.276911 11870 heartbeater.cc:511] Master 127.29.168.254:36933 requested a full tablet report, sending...
I20260808 14:41:11.277305 11573 ts_manager.cc:194] Registered new tserver with Master: 588008573cf24d4a888f8d97d27570dc (127.29.168.193:37053)
I20260808 14:41:11.277853 11573 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.193:50001
I20260808 14:41:11.279765 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 11674
I20260808 14:41:11.279847 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:41:11.279997 30371 external_mini_cluster.cc:1428] Setting key b4634232e724c3c8405c75a9af6eec3f
I20260808 14:41:11.280789 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36933
--builtin_ntp_servers=127.29.168.212:41507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:41:11.363581 11875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.363837 11875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.363859 11875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.364893 11875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.364943 11875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.364967 11875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:41:11.366272 11875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.366449 11875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.366688 11875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.371385 11885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.371450 11875 server_base.cc:1034] running on GCE node
W20260808 14:41:11.371455 11884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.371455 11889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.371853 11875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.372090 11875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.373256 11875 hybrid_clock.cc:648] HybridClock initialized: now 1786200071373261 us; error 44 us; skew 500 ppm
I20260808 14:41:11.374353 11875 webserver.cc:460] Webserver started at http://127.29.168.194:46637/ using document root <none> and password file <none>
I20260808 14:41:11.374593 11875 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.374656 11875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.374786 11875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.375844 11875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "7e73664db534477595373c96c85a561c"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "a71c6e36766521b6541ee5ed36b73ece"
server_key_iv: "6c75a5262699d3ef651d1cde9d88c373"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.376194 11875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "7e73664db534477595373c96c85a561c"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "a71c6e36766521b6541ee5ed36b73ece"
server_key_iv: "6c75a5262699d3ef651d1cde9d88c373"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.377449 11875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:41:11.378170 11900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.378363 11875 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:41:11.378450 11875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "7e73664db534477595373c96c85a561c"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "a71c6e36766521b6541ee5ed36b73ece"
server_key_iv: "6c75a5262699d3ef651d1cde9d88c373"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.378530 11875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.398020 11875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.398309 11875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.398455 11875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.398656 11875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:11.398984 11875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:11.399024 11875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.399055 11875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:11.399080 11875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.404850 11875 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:44801
I20260808 14:41:11.404899 12075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:44801 every 8 connection(s)
I20260808 14:41:11.405197 11875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:41:11.405812 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 11875
I20260808 14:41:11.405884 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:41:11.406116 30371 external_mini_cluster.cc:1428] Setting key 8d36441c5c4f0b9c7e34cfc71c9d14e4
I20260808 14:41:11.407166 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36933
--builtin_ntp_servers=127.29.168.212:41507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:41:11.411175 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.406009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:53013 (local address 127.29.168.254:36933)
0808 14:41:11.406090 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.406093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.406396 (+ 303us) server_negotiation.cc:407] Connection header received
0808 14:41:11.407018 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.407019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.407030 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.407085 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.407990 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.408513 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.409709 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.410017 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.410108 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.410927 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.410928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.410928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.410932 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.410946 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.410950 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.410993 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.411099 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.411123 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:41:11.411389 12079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.405973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:36933 (local address 127.29.168.194:53013)
0808 14:41:11.406251 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:11.406293 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:11.406912 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:11.407157 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:11.407161 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:11.407170 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:11.407892 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:11.407899 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.408617 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.408618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:11.409614 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:11.409617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.410127 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.410128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:11.410281 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.410774 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:41:11.410775 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:11.410808 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:41:11.410840 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:11.411011 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:11.411017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:11.411019 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:41:11.411093 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:41:11.411188 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":93,"threads_started":1}
I20260808 14:41:11.411895 12076 heartbeater.cc:347] Connected to a master server at 127.29.168.254:36933
I20260808 14:41:11.411972 12076 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:11.412129 12076 heartbeater.cc:511] Master 127.29.168.254:36933 requested a full tablet report, sending...
I20260808 14:41:11.412488 11573 ts_manager.cc:194] Registered new tserver with Master: 7e73664db534477595373c96c85a561c (127.29.168.194:44801)
I20260808 14:41:11.412863 11573 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.194:53013
W20260808 14:41:11.486366 12083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.486599 12083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.486637 12083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.487792 12083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.487852 12083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.487890 12083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:41:11.489230 12083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.489468 12083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.489732 12083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.494587 12097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.494695 12100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.494616 12098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.494846 12083 server_base.cc:1034] running on GCE node
I20260808 14:41:11.495061 12083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.495253 12083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.496450 12083 hybrid_clock.cc:648] HybridClock initialized: now 1786200071496437 us; error 32 us; skew 500 ppm
I20260808 14:41:11.497644 12083 webserver.cc:460] Webserver started at http://127.29.168.195:33043/ using document root <none> and password file <none>
I20260808 14:41:11.497866 12083 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.497911 12083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.498059 12083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.499024 12083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "e453a31974504aa7b03d84d2f9d4bc48"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "15e9edc58a152a7491d552020b9c84f2"
server_key_iv: "99b5f0a2207af59df7cc3b643be9dde4"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.499374 12083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "e453a31974504aa7b03d84d2f9d4bc48"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "15e9edc58a152a7491d552020b9c84f2"
server_key_iv: "99b5f0a2207af59df7cc3b643be9dde4"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.500667 12083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:41:11.501349 12109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.501531 12083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:41:11.501607 12083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "e453a31974504aa7b03d84d2f9d4bc48"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "15e9edc58a152a7491d552020b9c84f2"
server_key_iv: "99b5f0a2207af59df7cc3b643be9dde4"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.501655 12083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.521972 12083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.522272 12083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.522369 12083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.522531 12083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:11.522840 12083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:11.522871 12083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.522888 12083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:11.522938 12083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.528438 12083 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:41939
I20260808 14:41:11.528525 12286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:41939 every 8 connection(s)
I20260808 14:41:11.528815 12083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:41:11.533404 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 12083
I20260808 14:41:11.533505 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:41:11.533604 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.529518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:50399 (local address 127.29.168.254:36933)
0808 14:41:11.529572 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.529574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.529836 (+ 262us) server_negotiation.cc:407] Connection header received
0808 14:41:11.530266 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.530267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.530277 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.530328 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.530939 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.531416 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.532382 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.532555 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.532607 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.533296 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.533297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.533297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.533301 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.533314 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.533318 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.533357 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.533451 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.533501 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:41:11.533689 30371 external_mini_cluster.cc:1428] Setting key 3fc3c7efa03f005ebbff782821b6aed8
I20260808 14:41:11.533751 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.529511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:36933 (local address 127.29.168.195:50399)
0808 14:41:11.529723 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:11.529753 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:11.530187 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:11.530379 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:11.530381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:11.530389 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:11.530870 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:11.530874 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.531494 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.531495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:11.532307 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:11.532309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:11.532628 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:11.532629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:11.532724 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:11.533154 (+ 430us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:41:11.533154 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:11.533177 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:41:11.533196 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:11.533373 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:11.533377 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:11.533381 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:41:11.533448 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:41:11.533554 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":90,"threads_started":1}
I20260808 14:41:11.534309 12288 heartbeater.cc:347] Connected to a master server at 127.29.168.254:36933
I20260808 14:41:11.534394 12288 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:11.534572 12288 heartbeater.cc:511] Master 127.29.168.254:36933 requested a full tablet report, sending...
I20260808 14:41:11.534950 11573 ts_manager.cc:194] Registered new tserver with Master: e453a31974504aa7b03d84d2f9d4bc48 (127.29.168.195:41939)
I20260808 14:41:11.535267 11573 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.195:50399
I20260808 14:41:11.545413 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:41:11.547350 11673 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:11.546800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56664 (local address 127.29.168.254:36933)
0808 14:41:11.546887 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.546889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.547009 (+ 120us) server_negotiation.cc:407] Connection header received
0808 14:41:11.547084 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.547085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.547096 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.547151 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.547284 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56664: BlockingRecv error: recv got EOF from 127.0.0.1:56664 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:41:11.547416 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 11674
I20260808 14:41:11.565537 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 11875
I20260808 14:41:11.572942 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 12083
I20260808 14:41:11.581761 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 11511
2026-08-08T14:41:11Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (604 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T14:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:41:11Z Disabled control of system clock
I20260808 14:41:11.611595 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36913
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:36913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:41:11.689498 12311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.689675 12311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.689695 12311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.690747 12311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:41:11.690780 12311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.690793 12311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.690805 12311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:41:11.690817 12311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:41:11.692190 12311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:36913
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.692379 12311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.692610 12311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.697192 12321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.697180 12320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.697314 12311 server_base.cc:1034] running on GCE node
W20260808 14:41:11.697180 12323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.697650 12311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.697948 12311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.699091 12311 hybrid_clock.cc:648] HybridClock initialized: now 1786200071699074 us; error 39 us; skew 500 ppm
I20260808 14:41:11.700207 12311 webserver.cc:460] Webserver started at http://127.29.168.254:41363/ using document root <none> and password file <none>
I20260808 14:41:11.700403 12311 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.700440 12311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.700517 12311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.701419 12311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "e69e23ad74e94ea6a67ffcff5e231961"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "004e83c0c395eb26194e644f9ca17f49"
server_key_iv: "67e0907e0ab42327b76e9aae90a02862"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.701779 12311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "e69e23ad74e94ea6a67ffcff5e231961"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "004e83c0c395eb26194e644f9ca17f49"
server_key_iv: "67e0907e0ab42327b76e9aae90a02862"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.702970 12311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:41:11.703724 12332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.703893 12311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:41:11.703969 12311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "e69e23ad74e94ea6a67ffcff5e231961"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "004e83c0c395eb26194e644f9ca17f49"
server_key_iv: "67e0907e0ab42327b76e9aae90a02862"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.704020 12311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.707140 12311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.707346 12311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.707440 12311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.711035 12311 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:36913
I20260808 14:41:11.711079 12419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:36913 every 8 connection(s)
I20260808 14:41:11.711380 12311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:41:11.712092 12421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:11.714511 12421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961: Bootstrap starting.
I20260808 14:41:11.715034 12421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:11.715322 12421 log.cc:824] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:11.715380 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 12311
I20260808 14:41:11.715490 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:41:11.715696 30371 external_mini_cluster.cc:1428] Setting key 2a64a9eae9bfc10c33644e65b68b5563
I20260808 14:41:11.716168 12421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961: No bootstrap required, opened a new log
I20260808 14:41:11.717816 12421 raft_consensus.cc:348] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e23ad74e94ea6a67ffcff5e231961" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36913 } }
I20260808 14:41:11.717934 12421 raft_consensus.cc:374] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:11.717953 12421 raft_consensus.cc:729] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e69e23ad74e94ea6a67ffcff5e231961, State: Initialized, Role: FOLLOWER
I20260808 14:41:11.718098 12421 consensus_queue.cc:260] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e23ad74e94ea6a67ffcff5e231961" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36913 } }
I20260808 14:41:11.718221 12421 raft_consensus.cc:388] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:41:11.718273 12421 raft_consensus.cc:482] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:41:11.718322 12421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:11.718928 12421 raft_consensus.cc:504] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e23ad74e94ea6a67ffcff5e231961" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36913 } }
I20260808 14:41:11.719048 12421 leader_election.cc:302] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e69e23ad74e94ea6a67ffcff5e231961; no voters:
I20260808 14:41:11.719224 12421 leader_election.cc:288] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:41:11.719245 12430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:41:11.719468 12430 raft_consensus.cc:686] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [term 1 LEADER]: Becoming Leader. State: Replica: e69e23ad74e94ea6a67ffcff5e231961, State: Running, Role: LEADER
I20260808 14:41:11.719527 12421 sys_catalog.cc:564] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:41:11.719545 12430 consensus_queue.cc:237] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e23ad74e94ea6a67ffcff5e231961" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36913 } }
I20260808 14:41:11.719732 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.716228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35462 (local address 127.29.168.254:36913)
0808 14:41:11.716419 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.716427 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.718133 (+ 1706us) server_negotiation.cc:407] Connection header received
0808 14:41:11.718267 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.718274 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.718316 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.718448 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.719066 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.719070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.719070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.719074 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.719135 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.719148 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.719207 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.719263 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.719313 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260808 14:41:11.719890 12431 sys_catalog.cc:455] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e69e23ad74e94ea6a67ffcff5e231961. Latest consensus state: current_term: 1 leader_uuid: "e69e23ad74e94ea6a67ffcff5e231961" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e23ad74e94ea6a67ffcff5e231961" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36913 } } }
I20260808 14:41:11.719892 12435 sys_catalog.cc:455] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e69e23ad74e94ea6a67ffcff5e231961" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e23ad74e94ea6a67ffcff5e231961" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36913 } } }
I20260808 14:41:11.720018 12431 sys_catalog.cc:458] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:11.720067 12435 sys_catalog.cc:458] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961 [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:11.720357 12442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:41:11.720942 12442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:41:11.722330 12442 catalog_manager.cc:1347] Generated new cluster ID: d34a5e40766e4a49b881db62c931c789
I20260808 14:41:11.722378 12442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:41:11.750942 12442 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:41:11.751099 12442 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:41:11.754566 12442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e69e23ad74e94ea6a67ffcff5e231961: Generated new TSK 0
I20260808 14:41:11.754726 12442 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:41:11.761871 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36913
--builtin_ntp_servers=127.29.168.212:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:41:11.845238 12463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.845422 12463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.845443 12463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.846639 12463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.846680 12463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.846705 12463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:41:11.848105 12463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.848336 12463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.848613 12463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.853607 12472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.853674 12463 server_base.cc:1034] running on GCE node
W20260808 14:41:11.853658 12471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.853658 12475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.854079 12463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.854343 12463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.855537 12463 hybrid_clock.cc:648] HybridClock initialized: now 1786200071855516 us; error 32 us; skew 500 ppm
I20260808 14:41:11.856782 12463 webserver.cc:460] Webserver started at http://127.29.168.193:45241/ using document root <none> and password file <none>
I20260808 14:41:11.857038 12463 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.857101 12463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.857226 12463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.858208 12463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "d82b229ff21e45c28d790dc8b77aa1c4"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "874470339aae952a3d395aac38061b71"
server_key_iv: "dc692fa66547942e3afed0c62a58743c"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.858541 12463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "d82b229ff21e45c28d790dc8b77aa1c4"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "874470339aae952a3d395aac38061b71"
server_key_iv: "dc692fa66547942e3afed0c62a58743c"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.859843 12463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:41:11.860556 12488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.860718 12463 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:41:11.860814 12463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "d82b229ff21e45c28d790dc8b77aa1c4"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "874470339aae952a3d395aac38061b71"
server_key_iv: "dc692fa66547942e3afed0c62a58743c"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.860890 12463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.863884 12463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.864151 12463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.864347 12463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.864589 12463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:11.864964 12463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:11.865010 12463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.865049 12463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:11.865074 12463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.872654 12463 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38265
I20260808 14:41:11.872730 12660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38265 every 8 connection(s)
I20260808 14:41:11.873047 12463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:41:11.875953 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.873749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:39923 (local address 127.29.168.254:36913)
0808 14:41:11.873790 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.873793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.873979 (+ 186us) server_negotiation.cc:407] Connection header received
0808 14:41:11.874434 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.874435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.874444 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.874503 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.875661 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.875663 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.875663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.875668 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.875688 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.875692 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.875761 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.875865 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.875883 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:41:11.876143 12663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.873709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:36913 (local address 127.29.168.193:39923)
0808 14:41:11.873871 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:11.873900 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:11.874334 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:11.874561 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:11.874564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:11.874573 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:11.875490 (+ 917us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:41:11.875491 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:11.875515 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:41:11.875539 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:11.875768 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:11.875774 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:11.875776 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:41:11.875875 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:41:11.875934 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
I20260808 14:41:11.876653 12661 heartbeater.cc:347] Connected to a master server at 127.29.168.254:36913
I20260808 14:41:11.876727 12661 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:11.876893 12661 heartbeater.cc:511] Master 127.29.168.254:36913 requested a full tablet report, sending...
I20260808 14:41:11.877410 12359 ts_manager.cc:194] Registered new tserver with Master: d82b229ff21e45c28d790dc8b77aa1c4 (127.29.168.193:38265)
I20260808 14:41:11.877723 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 12463
I20260808 14:41:11.877815 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:41:11.878036 30371 external_mini_cluster.cc:1428] Setting key ad6e5a19b084bf0017137086122c315b
I20260808 14:41:11.878916 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36913
--builtin_ntp_servers=127.29.168.212:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:41:11.959385 12664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:11.959584 12664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:11.959605 12664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:11.960719 12664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:11.960768 12664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:11.960794 12664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:41:11.962026 12664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:11.962188 12664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:11.962417 12664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:11.967336 12671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.967411 12674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:11.967383 12672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:11.967691 12664 server_base.cc:1034] running on GCE node
I20260808 14:41:11.967965 12664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:11.968233 12664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:11.969373 12664 hybrid_clock.cc:648] HybridClock initialized: now 1786200071969357 us; error 37 us; skew 500 ppm
I20260808 14:41:11.970682 12664 webserver.cc:460] Webserver started at http://127.29.168.194:36717/ using document root <none> and password file <none>
I20260808 14:41:11.970952 12664 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:11.971024 12664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:11.971169 12664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:11.972257 12664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "f44db239b52b4894abd988144419904c"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "3faa987579897befb2bf2f580331e083"
server_key_iv: "d40cb15868118c487dc9695d928c2c5e"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.972607 12664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "f44db239b52b4894abd988144419904c"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "3faa987579897befb2bf2f580331e083"
server_key_iv: "d40cb15868118c487dc9695d928c2c5e"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.973891 12664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:41:11.974630 12680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.974830 12664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:41:11.974927 12664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "f44db239b52b4894abd988144419904c"
format_stamp: "Formatted at 2026-08-08 14:41:11 on dist-test-slave-mjjr"
server_key: "3faa987579897befb2bf2f580331e083"
server_key_iv: "d40cb15868118c487dc9695d928c2c5e"
server_key_version: "encryptionkey@0"
I20260808 14:41:11.974999 12664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:11.978349 12664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:11.978608 12664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:11.978735 12664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:11.978955 12664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:11.979245 12664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:11.979300 12664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.979336 12664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:11.979364 12664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:11.985540 12664 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:34323
I20260808 14:41:11.985584 12850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:34323 every 8 connection(s)
I20260808 14:41:11.985898 12664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:41:11.988658 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.986599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:36571 (local address 127.29.168.254:36913)
0808 14:41:11.986668 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:11.986671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:11.986909 (+ 238us) server_negotiation.cc:407] Connection header received
0808 14:41:11.987306 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:11.987307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:11.987312 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:11.987369 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:11.988484 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:11.988485 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:11.988485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:11.988488 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:11.988501 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:11.988504 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:11.988548 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:11.988596 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:41:11.988608 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:41:11.988850 12855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:11.986581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:36913 (local address 127.29.168.194:36571)
0808 14:41:11.986802 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:11.986832 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:11.987218 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:11.987416 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:11.987419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:11.987426 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:11.988365 (+ 939us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:41:11.988366 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:11.988390 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:41:11.988414 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:11.988545 (+ 131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:11.988547 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:11.988549 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:41:11.988596 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:41:11.988637 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260808 14:41:11.989327 12853 heartbeater.cc:347] Connected to a master server at 127.29.168.254:36913
I20260808 14:41:11.989421 12853 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:11.989621 12853 heartbeater.cc:511] Master 127.29.168.254:36913 requested a full tablet report, sending...
I20260808 14:41:11.989992 12359 ts_manager.cc:194] Registered new tserver with Master: f44db239b52b4894abd988144419904c (127.29.168.194:34323)
I20260808 14:41:11.993952 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 12664
I20260808 14:41:11.994035 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:41:11.994201 30371 external_mini_cluster.cc:1428] Setting key 1580b25f53a351c598950572291bcaa9
I20260808 14:41:11.995011 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36913
--builtin_ntp_servers=127.29.168.212:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:41:12.074461 12857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:12.074664 12857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:12.074685 12857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:12.075753 12857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:12.075789 12857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:12.075814 12857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:41:12.077057 12857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:36913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:12.077250 12857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:12.077636 12857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:12.082327 12865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:12.082293 12866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:12.082314 12869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:12.082585 12857 server_base.cc:1034] running on GCE node
I20260808 14:41:12.082855 12857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:12.083106 12857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:12.084286 12857 hybrid_clock.cc:648] HybridClock initialized: now 1786200072084246 us; error 31 us; skew 500 ppm
I20260808 14:41:12.085579 12857 webserver.cc:460] Webserver started at http://127.29.168.195:34593/ using document root <none> and password file <none>
I20260808 14:41:12.085871 12857 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:12.085948 12857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:12.086109 12857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:12.087162 12857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "ae9c4b2b012d4f84a8b6528c8d60b4c7"
format_stamp: "Formatted at 2026-08-08 14:41:12 on dist-test-slave-mjjr"
server_key: "28bd078ec463294ef116f8c0fdc7faeb"
server_key_iv: "fbb86364f454fa752f25f518216f1025"
server_key_version: "encryptionkey@0"
I20260808 14:41:12.087553 12857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "ae9c4b2b012d4f84a8b6528c8d60b4c7"
format_stamp: "Formatted at 2026-08-08 14:41:12 on dist-test-slave-mjjr"
server_key: "28bd078ec463294ef116f8c0fdc7faeb"
server_key_iv: "fbb86364f454fa752f25f518216f1025"
server_key_version: "encryptionkey@0"
I20260808 14:41:12.088924 12857 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:41:12.089638 12879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:12.089836 12857 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:41:12.089916 12857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "ae9c4b2b012d4f84a8b6528c8d60b4c7"
format_stamp: "Formatted at 2026-08-08 14:41:12 on dist-test-slave-mjjr"
server_key: "28bd078ec463294ef116f8c0fdc7faeb"
server_key_iv: "fbb86364f454fa752f25f518216f1025"
server_key_version: "encryptionkey@0"
I20260808 14:41:12.089979 12857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:12.093312 12857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:12.093504 12857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:12.093592 12857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:12.093734 12857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:12.094023 12857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:12.094070 12857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:12.094090 12857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:12.094101 12857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:12.099783 12857 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:43165
I20260808 14:41:12.099898 13062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:43165 every 8 connection(s)
I20260808 14:41:12.100167 12857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:41:12.102705 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:12.100853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:55543 (local address 127.29.168.254:36913)
0808 14:41:12.100912 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:12.100914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:12.101117 (+ 203us) server_negotiation.cc:407] Connection header received
0808 14:41:12.101472 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:12.101473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:12.101495 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:12.101552 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:12.102516 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:12.102517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:12.102517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:41:12.102521 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:12.102535 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:41:12.102539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:12.102581 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:12.102642 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:41:12.102654 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:41:12.102885 13066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:12.100810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:36913 (local address 127.29.168.195:55543)
0808 14:41:12.100992 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:12.101027 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:12.101398 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:12.101596 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:12.101599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:12.101606 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:12.102376 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:41:12.102376 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:12.102398 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:41:12.102421 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:12.102585 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:12.102587 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:12.102589 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:41:12.102646 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:41:12.102686 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260808 14:41:12.103310 13063 heartbeater.cc:347] Connected to a master server at 127.29.168.254:36913
I20260808 14:41:12.103394 13063 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:12.103497 13063 heartbeater.cc:511] Master 127.29.168.254:36913 requested a full tablet report, sending...
I20260808 14:41:12.103837 12359 ts_manager.cc:194] Registered new tserver with Master: ae9c4b2b012d4f84a8b6528c8d60b4c7 (127.29.168.195:43165)
I20260808 14:41:12.110019 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 12857
I20260808 14:41:12.110095 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:41:12.110239 30371 external_mini_cluster.cc:1428] Setting key 02972da4ee490364db3cd2ead7edd0c1
I20260808 14:41:12.111084 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:41:12.112743 12429 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:41:12.112388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35474 (local address 127.29.168.254:36913)
0808 14:41:12.112437 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:12.112438 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:12.112527 (+ 89us) server_negotiation.cc:407] Connection header received
0808 14:41:12.112563 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:12.112564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:12.112567 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:12.112615 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:12.112700 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35474: BlockingRecv error: recv got EOF from 127.0.0.1:35474 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:41:12.112835 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 12463
I20260808 14:41:12.125890 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 12664
I20260808 14:41:12.147433 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 12857
I20260808 14:41:12.153710 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 12311
2026-08-08T14:41:12Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (571 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:41:12 dist-test-slave-mjjr krb5kdc[13078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:41:12 dist-test-slave-mjjr krb5kdc[13078](info): set up 2 sockets
Aug 08 14:41:12 dist-test-slave-mjjr krb5kdc[13078](info): commencing operation
krb5kdc: starting...
W20260808 14:41:13.341197 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:41:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:41:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:41:13.452273 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39627
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:39627
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:13.529511 13100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:13.529727 13100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:13.529764 13100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:13.530830 13100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:41:13.530896 13100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:13.530920 13100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:13.530938 13100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:41:13.530966 13100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:41:13.532294 13100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:39627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:13.532569 13100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:13.532768 13100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:13.537360 13121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:13.537344 13116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:13.537338 13117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:13.537549 13100 server_base.cc:1034] running on GCE node
I20260808 14:41:13.537786 13100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:13.538051 13100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:13.539211 13100 hybrid_clock.cc:648] HybridClock initialized: now 1786200073539199 us; error 23 us; skew 500 ppm
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:13.541417 13100 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:41:13.541846 13100 webserver.cc:460] Webserver started at http://127.29.168.254:41701/ using document root <none> and password file <none>
I20260808 14:41:13.542049 13100 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:13.542109 13100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:13.542227 13100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:13.543128 13100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "a713bbe081fb4a5da9770d1496bbaace"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "d9b1b90c9ee0f999a025cf234875f9b5"
server_key_iv: "5b224e020ee3c0e4535d6461621a9663"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.543488 13100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "a713bbe081fb4a5da9770d1496bbaace"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "d9b1b90c9ee0f999a025cf234875f9b5"
server_key_iv: "5b224e020ee3c0e4535d6461621a9663"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.544888 13100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:41:13.545650 13133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.545869 13100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:41:13.545962 13100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "a713bbe081fb4a5da9770d1496bbaace"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "d9b1b90c9ee0f999a025cf234875f9b5"
server_key_iv: "5b224e020ee3c0e4535d6461621a9663"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.546052 13100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:13.565266 13100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:13.567095 13100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:13.567248 13100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:13.571831 13100 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:39627
I20260808 14:41:13.571882 13224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:39627 every 8 connection(s)
I20260808 14:41:13.572216 13100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:41:13.573213 13225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:13.575403 13225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace: Bootstrap starting.
I20260808 14:41:13.576092 13225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:13.576366 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 13100
I20260808 14:41:13.576401 13225 log.cc:824] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:13.576450 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:41:13.576689 30371 external_mini_cluster.cc:1428] Setting key f39b9326b4cad3b38a0fe509625fd39f
I20260808 14:41:13.577340 13225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace: No bootstrap required, opened a new log
I20260808 14:41:13.579892 13225 raft_consensus.cc:348] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a713bbe081fb4a5da9770d1496bbaace" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39627 } }
I20260808 14:41:13.580056 13225 raft_consensus.cc:374] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:13.580106 13225 raft_consensus.cc:729] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a713bbe081fb4a5da9770d1496bbaace, State: Initialized, Role: FOLLOWER
I20260808 14:41:13.580230 13225 consensus_queue.cc:260] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a713bbe081fb4a5da9770d1496bbaace" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39627 } }
I20260808 14:41:13.580334 13225 raft_consensus.cc:388] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:41:13.580358 13225 raft_consensus.cc:482] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:41:13.580431 13225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:13.581113 13225 raft_consensus.cc:504] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a713bbe081fb4a5da9770d1496bbaace" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39627 } }
I20260808 14:41:13.581239 13225 leader_election.cc:302] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a713bbe081fb4a5da9770d1496bbaace; no voters:
I20260808 14:41:13.581401 13225 leader_election.cc:288] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:41:13.581465 13235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:41:13.581615 13235 raft_consensus.cc:686] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [term 1 LEADER]: Becoming Leader. State: Replica: a713bbe081fb4a5da9770d1496bbaace, State: Running, Role: LEADER
I20260808 14:41:13.581642 13225 sys_catalog.cc:564] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:41:13.581776 13235 consensus_queue.cc:237] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a713bbe081fb4a5da9770d1496bbaace" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39627 } }
I20260808 14:41:13.582082 13235 sys_catalog.cc:455] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [sys.catalog]: SysCatalogTable state changed. Reason: New leader a713bbe081fb4a5da9770d1496bbaace. Latest consensus state: current_term: 1 leader_uuid: "a713bbe081fb4a5da9770d1496bbaace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a713bbe081fb4a5da9770d1496bbaace" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39627 } } }
I20260808 14:41:13.582113 13238 sys_catalog.cc:455] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a713bbe081fb4a5da9770d1496bbaace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a713bbe081fb4a5da9770d1496bbaace" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39627 } } }
I20260808 14:41:13.582154 13235 sys_catalog.cc:458] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:13.582156 13238 sys_catalog.cc:458] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:13.582454 13241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:41:13.582909 13241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:13.584646 13241 catalog_manager.cc:1347] Generated new cluster ID: dca3851405f94def919ab0036d9d0475
I20260808 14:41:13.584702 13241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:41:13.588429 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:13.577197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54226 (local address 127.29.168.254:39627)
0808 14:41:13.577399 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:13.577406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:13.577441 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:41:13.577907 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:13.577915 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:13.577974 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:13.578113 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:13.578636 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.579936 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.580898 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.581523 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.581993 (+ 470us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:13.584726 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:13.584729 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:13.584729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:13.584740 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:13.586716 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:13.587132 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:13.587135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:13.587135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:13.587245 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:13.587460 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:13.587461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:13.587461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:13.587798 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:13.587975 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:13.588097 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:41:13.588227 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":96,"threads_started":1}
I20260808 14:41:13.597106 13241 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:41:13.597834 13241 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:41:13.605221 13241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace: Generated new TSK 0
I20260808 14:41:13.605376 13241 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:41:13.632153 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39627
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:13.711987 13264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:13.712157 13264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:13.712179 13264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:13.713165 13264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:13.713212 13264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:13.713235 13264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:41:13.714555 13264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:13.714725 13264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:13.714888 13264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:13.719678 13272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:13.719719 13264 server_base.cc:1034] running on GCE node
W20260808 14:41:13.719689 13270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:13.719689 13276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:13.720068 13264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:13.720255 13264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:13.721410 13264 hybrid_clock.cc:648] HybridClock initialized: now 1786200073721403 us; error 38 us; skew 500 ppm
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:13.723675 13264 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:41:13.724116 13264 webserver.cc:460] Webserver started at http://127.29.168.193:41085/ using document root <none> and password file <none>
I20260808 14:41:13.724345 13264 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:13.724409 13264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:13.724563 13264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:13.725548 13264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "9470a0119c934b16a3150250a9a608d6"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "dfc58f5aa4266d5088a12fb8ba8bfbf1"
server_key_iv: "fa6a4c3b6a30122ef58c2b374a8bfbea"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.725921 13264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "9470a0119c934b16a3150250a9a608d6"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "dfc58f5aa4266d5088a12fb8ba8bfbf1"
server_key_iv: "fa6a4c3b6a30122ef58c2b374a8bfbea"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.727380 13264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:41:13.728196 13287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.728381 13264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.728477 13264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "9470a0119c934b16a3150250a9a608d6"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "dfc58f5aa4266d5088a12fb8ba8bfbf1"
server_key_iv: "fa6a4c3b6a30122ef58c2b374a8bfbea"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.728555 13264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:13.746384 13264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:13.748245 13264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:13.748400 13264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:13.748701 13264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:13.748993 13264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:13.749048 13264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.749089 13264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:13.749116 13264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.754791 13264 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:40771
I20260808 14:41:13.754845 13463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:40771 every 8 connection(s)
I20260808 14:41:13.755120 13264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:41:13.756531 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 13264
I20260808 14:41:13.756745 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:41:13.756949 30371 external_mini_cluster.cc:1428] Setting key f5efa5708e0c477aa28b059290a1d1db
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:13.764882 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:13.755858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:55435 (local address 127.29.168.254:39627)
0808 14:41:13.755918 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:13.755923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:13.756218 (+ 295us) server_negotiation.cc:407] Connection header received
0808 14:41:13.756643 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:13.756645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:13.756658 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:13.756721 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:13.757805 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.758281 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.759194 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.759515 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.759603 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:13.761829 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:13.761831 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:13.761831 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:13.761840 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:13.763448 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:13.763904 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:13.763906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:13.763906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:13.763969 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:13.764208 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:13.764209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:13.764209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:13.764379 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:13.764454 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:13.764691 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 14:41:13.764783 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:41:13.764953 13466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:13.755892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39627 (local address 127.29.168.193:55435)
0808 14:41:13.756088 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:13.756121 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:13.756540 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:13.756790 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:13.756793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:13.757476 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:13.757706 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:13.757711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.758381 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.758382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:13.759108 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:13.759110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.759628 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.759629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:13.759810 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:13.760324 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:13.760331 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:13.761738 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:13.763532 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:13.763539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:13.763541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:13.763830 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:13.764043 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:13.764043 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:13.764043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:13.764143 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:13.764451 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:13.764456 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:13.764560 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 14:41:13.764642 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:41:13.764777 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":118,"threads_started":1}
I20260808 14:41:13.765578 13464 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39627
I20260808 14:41:13.765707 13464 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:13.765911 13464 heartbeater.cc:511] Master 127.29.168.254:39627 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
I20260808 14:41:13.766530 13159 ts_manager.cc:194] Registered new tserver with Master: 9470a0119c934b16a3150250a9a608d6 (127.29.168.193:40771)
I20260808 14:41:13.767127 13159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:55435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:41:13.782521 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39627
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:13.861814 13470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:13.862002 13470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:13.862025 13470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:13.863080 13470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:13.863111 13470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:13.863132 13470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:41:13.864773 13470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:13.865015 13470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:13.865262 13470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:13.870864 13481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:13.871284 13475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:13.872115 13470 server_base.cc:1034] running on GCE node
W20260808 14:41:13.872573 13476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:13.872870 13470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:13.873118 13470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:13.874366 13470 hybrid_clock.cc:648] HybridClock initialized: now 1786200073874349 us; error 32 us; skew 500 ppm
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:13.877475 13470 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:41:13.877943 13470 webserver.cc:460] Webserver started at http://127.29.168.194:44659/ using document root <none> and password file <none>
I20260808 14:41:13.878193 13470 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:13.878269 13470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:13.878394 13470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:13.879736 13470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "c5d858b6c6b44d579338ca664a99a7d4"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "1946a4e1f83b6574ba9820be3169a074"
server_key_iv: "9df8fc55874ff37aba4a60cf07ab510b"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.880079 13470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "c5d858b6c6b44d579338ca664a99a7d4"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "1946a4e1f83b6574ba9820be3169a074"
server_key_iv: "9df8fc55874ff37aba4a60cf07ab510b"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.881330 13470 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:41:13.881973 13492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.882179 13470 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.882323 13470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "c5d858b6c6b44d579338ca664a99a7d4"
format_stamp: "Formatted at 2026-08-08 14:41:13 on dist-test-slave-mjjr"
server_key: "1946a4e1f83b6574ba9820be3169a074"
server_key_iv: "9df8fc55874ff37aba4a60cf07ab510b"
server_key_version: "encryptionkey@0"
I20260808 14:41:13.882411 13470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:13.902508 13470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:13.904419 13470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:13.904587 13470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:13.904814 13470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:13.905148 13470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:13.905205 13470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.905239 13470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:13.905267 13470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:13.911144 13470 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:46419
I20260808 14:41:13.911198 13680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:46419 every 8 connection(s)
I20260808 14:41:13.911537 13470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:41:13 dist-test-slave-mjjr krb5kdc[13078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200073, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:13.917327 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 13470
I20260808 14:41:13.917445 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:41:13.917639 30371 external_mini_cluster.cc:1428] Setting key 336c8ecbd2114f5e90b20a941b438a5e
I20260808 14:41:13.920490 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:13.912345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:40009 (local address 127.29.168.254:39627)
0808 14:41:13.912409 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:13.912411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:13.912589 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:41:13.913014 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:13.913015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:13.913024 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:13.913075 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:13.913898 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.914380 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.915281 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.915485 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.915533 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:13.917656 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:13.917658 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:13.917659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:13.917666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:13.919060 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:13.919503 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:13.919504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:13.919504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:13.919553 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:13.919834 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:13.919835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:13.919835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:13.919926 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:13.919973 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:13.920292 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 14:41:13.920376 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:41:13.920583 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:13.912294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39627 (local address 127.29.168.194:40009)
0808 14:41:13.912471 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:13.912508 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:13.912938 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:13.913123 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:13.913125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:13.913662 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:13.913828 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:13.913832 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.914471 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.914472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:13.915192 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:13.915194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:13.915556 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:13.915557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:13.915675 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:13.916086 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:13.916094 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:13.917546 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:13.919137 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:13.919144 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:13.919146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:13.919432 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:13.919615 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:13.919616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:13.919616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:13.919767 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:13.919986 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:13.919992 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:13.920138 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 14:41:13.920253 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:41:13.920407 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260808 14:41:13.921044 13683 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39627
I20260808 14:41:13.921150 13683 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:13.921314 13683 heartbeater.cc:511] Master 127.29.168.254:39627 requested a full tablet report, sending...
I20260808 14:41:13.921751 13159 ts_manager.cc:194] Registered new tserver with Master: c5d858b6c6b44d579338ca664a99a7d4 (127.29.168.194:46419)
I20260808 14:41:13.922247 13159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:40009
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:41:13.942039 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39627
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:14.020615 13688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:14.020798 13688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:14.020819 13688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:14.021771 13688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:14.021803 13688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:14.021826 13688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:41:14.023051 13688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:14.023211 13688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:14.023386 13688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:14.028105 13698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:14.028092 13694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:14.028093 13695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:14.028204 13688 server_base.cc:1034] running on GCE node
I20260808 14:41:14.028422 13688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:14.028687 13688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:14.029844 13688 hybrid_clock.cc:648] HybridClock initialized: now 1786200074029832 us; error 43 us; skew 500 ppm
Aug 08 14:41:14 dist-test-slave-mjjr krb5kdc[13078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200074, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:14.032452 13688 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:41:14.032835 13688 webserver.cc:460] Webserver started at http://127.29.168.195:34627/ using document root <none> and password file <none>
I20260808 14:41:14.033054 13688 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:14.033118 13688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:14.033260 13688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:41:14.034193 13688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "97f74f4405854f6dbad79701d509a7e9"
format_stamp: "Formatted at 2026-08-08 14:41:14 on dist-test-slave-mjjr"
server_key: "0406d80f8f90a24c61c21bf9e0d4ae2a"
server_key_iv: "c14d078b44613b80a886a8cde3f65f98"
server_key_version: "encryptionkey@0"
I20260808 14:41:14.034544 13688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "97f74f4405854f6dbad79701d509a7e9"
format_stamp: "Formatted at 2026-08-08 14:41:14 on dist-test-slave-mjjr"
server_key: "0406d80f8f90a24c61c21bf9e0d4ae2a"
server_key_iv: "c14d078b44613b80a886a8cde3f65f98"
server_key_version: "encryptionkey@0"
I20260808 14:41:14.035838 13688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:41:14.036598 13707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:14.036770 13688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:41:14.036870 13688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "97f74f4405854f6dbad79701d509a7e9"
format_stamp: "Formatted at 2026-08-08 14:41:14 on dist-test-slave-mjjr"
server_key: "0406d80f8f90a24c61c21bf9e0d4ae2a"
server_key_iv: "c14d078b44613b80a886a8cde3f65f98"
server_key_version: "encryptionkey@0"
I20260808 14:41:14.036947 13688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:14.061088 13688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:14.063354 13688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:14.063519 13688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:14.063788 13688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:14.064105 13688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:14.064154 13688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:14.064190 13688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:14.064215 13688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:14.069893 13688 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:42937
I20260808 14:41:14.069985 13894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:42937 every 8 connection(s)
I20260808 14:41:14.070276 13688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:41:14 dist-test-slave-mjjr krb5kdc[13078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200074, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:14.076665 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 13688
I20260808 14:41:14.076784 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:41:14.077018 30371 external_mini_cluster.cc:1428] Setting key 2e2cf225a5ba88664be831d3cafe8400
I20260808 14:41:14.079100 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.071039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:37775 (local address 127.29.168.254:39627)
0808 14:41:14.071118 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.071121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.071277 (+ 156us) server_negotiation.cc:407] Connection header received
0808 14:41:14.071844 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.071845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.071859 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.071933 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:14.072773 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.073240 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.074108 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.074273 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.074318 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.076229 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:14.076231 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:14.076231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:14.076237 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:14.077827 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:14.078219 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:14.078220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:14.078221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:14.078286 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:14.078522 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:14.078523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:14.078523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:14.078628 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:14.078693 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.078947 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.079018 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:41:14.079257 13898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.070977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39627 (local address 127.29.168.195:37775)
0808 14:41:14.071163 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.071195 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:14.071695 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:14.071983 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:14.071986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:14.072522 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:14.072692 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.072696 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.073322 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.073323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.074042 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.074043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.074346 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.074347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.074436 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.074779 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:14.074786 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:14.076145 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:14.077913 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:14.077919 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:14.077922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:14.078146 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:14.078354 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:14.078355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:14.078355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:14.078453 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:14.078696 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:14.078702 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:14.078826 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 14:41:14.078916 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:41:14.079052 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260808 14:41:14.079681 13896 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39627
I20260808 14:41:14.079788 13896 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:14.079955 13896 heartbeater.cc:511] Master 127.29.168.254:39627 requested a full tablet report, sending...
I20260808 14:41:14.080304 13159 ts_manager.cc:194] Registered new tserver with Master: 97f74f4405854f6dbad79701d509a7e9 (127.29.168.195:42937)
I20260808 14:41:14.080650 13159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:37775
I20260808 14:41:14.088752 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:41:14.094879 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.090104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54236 (local address 127.29.168.254:39627)
0808 14:41:14.090154 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.090155 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.090263 (+ 108us) server_negotiation.cc:407] Connection header received
0808 14:41:14.090294 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.090295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.090302 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.090346 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:14.090805 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.091209 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.091876 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.092019 (+ 143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.092063 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.092946 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:14.092948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:14.092948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:14.092953 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:14.094096 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:14.094361 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:14.094362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:14.094362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:14.094405 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:14.094510 (+ 105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:14.094510 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:14.094510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:14.094609 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:14.094673 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.094768 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.094823 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:41:14.096454 13159 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:41:14.098035 13159 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:41:14.104477 13916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.100125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:40771 (local address 127.0.0.1:40008)
0808 14:41:14.100460 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.100471 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:14.100522 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:14.100701 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:14.100704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:14.100706 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:14.100768 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.100770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.102112 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.102113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.103393 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.103397 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.104135 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.104136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.104269 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.104287 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 14:41:14.104359 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:41:14.104408 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":25,"thread_start_us":48,"threads_started":1}
I20260808 14:41:14.104553 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.100321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40008 (local address 127.29.168.193:40771)
0808 14:41:14.100519 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.100524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.100535 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:41:14.100576 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.100578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.100592 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.100667 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:14.100870 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.102016 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.103464 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.104041 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.104126 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.104181 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.104390 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.104440 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":82,"threads_started":1}
I20260808 14:41:14.105224 13356 tablet_service.cc:1467] Processing CreateTablet for tablet 92cc036bb2be47be8b227bb37773a41f (DEFAULT_TABLE table=test-table [id=8b59c628906e4e4c928a1cc071b1542f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:41:14.105405 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.100146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:46419 (local address 127.0.0.1:37798)
0808 14:41:14.100466 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.100476 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:14.100513 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:14.100818 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:14.100820 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:14.100822 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:14.100866 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.100869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.103054 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.103055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.104205 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.104208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.105149 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.105150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.105210 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.105214 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:41:14.105278 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:41:14.105321 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":1,"thread_start_us":66,"threads_started":1}
I20260808 14:41:14.105427 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.100356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.29.168.194:46419)
0808 14:41:14.100630 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.100634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.100642 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:41:14.100702 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.100704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.100719 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.100804 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:14.100934 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.102021 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.104294 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.105028 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.105133 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.105184 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.105307 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.105346 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":80,"threads_started":1}
I20260808 14:41:14.105626 13356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92cc036bb2be47be8b227bb37773a41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:14.106057 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.100125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:42937 (local address 127.0.0.1:44014)
0808 14:41:14.100277 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.100314 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:14.100375 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:14.102143 (+ 1768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:14.102144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:14.102146 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:14.102183 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.102204 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.103408 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.103409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.104451 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.104454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.105800 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.105801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.105868 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.105872 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:41:14.105944 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:41:14.105983 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":2,"thread_start_us":52,"threads_started":1}
I20260808 14:41:14.106070 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.100299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44014 (local address 127.29.168.195:42937)
0808 14:41:14.100794 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.100797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.100807 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:41:14.100841 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.100843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.100857 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.100936 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:14.102294 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.103305 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.104679 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.105716 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.105800 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.105859 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.105957 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.105994 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":86,"threads_started":1}
I20260808 14:41:14.106025 13577 tablet_service.cc:1467] Processing CreateTablet for tablet 92cc036bb2be47be8b227bb37773a41f (DEFAULT_TABLE table=test-table [id=8b59c628906e4e4c928a1cc071b1542f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:41:14.106334 13577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92cc036bb2be47be8b227bb37773a41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:14.106735 13782 tablet_service.cc:1467] Processing CreateTablet for tablet 92cc036bb2be47be8b227bb37773a41f (DEFAULT_TABLE table=test-table [id=8b59c628906e4e4c928a1cc071b1542f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:41:14.107024 13782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92cc036bb2be47be8b227bb37773a41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:14.109114 13922 tablet_bootstrap.cc:492] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: Bootstrap starting.
I20260808 14:41:14.109619 13923 tablet_bootstrap.cc:492] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Bootstrap starting.
I20260808 14:41:14.109927 13922 tablet_bootstrap.cc:654] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:14.110024 13924 tablet_bootstrap.cc:492] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Bootstrap starting.
I20260808 14:41:14.110299 13923 tablet_bootstrap.cc:654] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:14.110637 13922 log.cc:824] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:14.110702 13924 tablet_bootstrap.cc:654] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:14.110858 13923 log.cc:824] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:14.111222 13924 log.cc:824] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:14.111443 13922 tablet_bootstrap.cc:492] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: No bootstrap required, opened a new log
I20260808 14:41:14.111519 13922 ts_tablet_manager.cc:1397] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:41:14.112001 13924 tablet_bootstrap.cc:492] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: No bootstrap required, opened a new log
I20260808 14:41:14.112077 13924 ts_tablet_manager.cc:1397] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:41:14.112135 13923 tablet_bootstrap.cc:492] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: No bootstrap required, opened a new log
I20260808 14:41:14.112202 13923 ts_tablet_manager.cc:1397] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:41:14.113421 13923 raft_consensus.cc:348] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.113574 13923 raft_consensus.cc:374] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:14.113485 13922 raft_consensus.cc:348] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.113619 13923 raft_consensus.cc:729] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d858b6c6b44d579338ca664a99a7d4, State: Initialized, Role: FOLLOWER
I20260808 14:41:14.113646 13922 raft_consensus.cc:374] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:14.113689 13922 raft_consensus.cc:729] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9470a0119c934b16a3150250a9a608d6, State: Initialized, Role: FOLLOWER
I20260808 14:41:14.113749 13923 consensus_queue.cc:260] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.113806 13922 consensus_queue.cc:260] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.113885 13924 raft_consensus.cc:348] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.114029 13923 ts_tablet_manager.cc:1428] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:41:14.114034 13924 raft_consensus.cc:374] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:14.114087 13924 raft_consensus.cc:729] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f74f4405854f6dbad79701d509a7e9, State: Initialized, Role: FOLLOWER
I20260808 14:41:14.114096 13922 ts_tablet_manager.cc:1428] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:41:14.114172 13683 heartbeater.cc:503] Master 127.29.168.254:39627 was elected leader, sending a full tablet report...
I20260808 14:41:14.114208 13924 consensus_queue.cc:260] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.114307 13464 heartbeater.cc:503] Master 127.29.168.254:39627 was elected leader, sending a full tablet report...
I20260808 14:41:14.114465 13924 ts_tablet_manager.cc:1428] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:41:14.114499 13896 heartbeater.cc:503] Master 127.29.168.254:39627 was elected leader, sending a full tablet report...
W20260808 14:41:14.162240 13684 tablet.cc:2369] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:41:14.255998 13465 tablet.cc:2369] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:41:14.320842 13897 tablet.cc:2369] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:41:14.376502 13930 raft_consensus.cc:482] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:41:14.376628 13930 raft_consensus.cc:504] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.376962 13930 leader_election.cc:288] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97f74f4405854f6dbad79701d509a7e9 (127.29.168.195:42937), 9470a0119c934b16a3150250a9a608d6 (127.29.168.193:40771)
I20260808 14:41:14.379842 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.377381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:44243 (local address 127.29.168.193:40771)
0808 14:41:14.377455 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.377457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.377464 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:41:14.377506 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.377507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.377514 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.377583 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:14.377748 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.378216 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.379122 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.379475 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.379554 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.379563 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.379721 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.379756 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:41:14.379845 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.377189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:40771 (local address 127.29.168.194:44243)
0808 14:41:14.377260 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.377273 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:14.377319 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:14.377590 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:14.377591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:14.377593 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:14.377675 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.377677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.378308 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.378309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.379027 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.379029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.379554 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.379555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.379633 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.379653 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 14:41:14.379715 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 14:41:14.379761 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":2}
I20260808 14:41:14.379938 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.377270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:60987 (local address 127.29.168.195:42937)
0808 14:41:14.377318 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.377320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.377531 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:41:14.377599 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.377600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.377611 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.377692 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:14.377848 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.378291 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.379177 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.379542 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.379628 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.379635 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.379809 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.379847 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:41:14.379985 13933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.377189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:42937 (local address 127.29.168.194:60987)
0808 14:41:14.377424 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.377433 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:14.377541 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:14.377694 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:14.377695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:14.377697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:14.377774 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.377775 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.378380 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.378381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.379084 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:14.379086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.379628 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.379629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:14.379720 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.379723 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:41:14.379803 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:41:14.379847 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":13,"thread_start_us":141,"threads_started":1}
I20260808 14:41:14.380199 13391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cc036bb2be47be8b227bb37773a41f" candidate_uuid: "c5d858b6c6b44d579338ca664a99a7d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9470a0119c934b16a3150250a9a608d6" is_pre_election: true
I20260808 14:41:14.380342 13391 raft_consensus.cc:2454] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d858b6c6b44d579338ca664a99a7d4 in term 0.
I20260808 14:41:14.380379 13809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cc036bb2be47be8b227bb37773a41f" candidate_uuid: "c5d858b6c6b44d579338ca664a99a7d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f74f4405854f6dbad79701d509a7e9" is_pre_election: true
I20260808 14:41:14.380541 13809 raft_consensus.cc:2454] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d858b6c6b44d579338ca664a99a7d4 in term 0.
I20260808 14:41:14.380574 13494 leader_election.cc:302] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9470a0119c934b16a3150250a9a608d6, c5d858b6c6b44d579338ca664a99a7d4; no voters:
I20260808 14:41:14.380702 13930 raft_consensus.cc:2781] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:41:14.380752 13930 raft_consensus.cc:482] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:41:14.380774 13930 raft_consensus.cc:3037] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:14.381644 13930 raft_consensus.cc:504] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.381775 13930 leader_election.cc:288] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [CANDIDATE]: Term 1 election: Requested vote from peers 97f74f4405854f6dbad79701d509a7e9 (127.29.168.195:42937), 9470a0119c934b16a3150250a9a608d6 (127.29.168.193:40771)
I20260808 14:41:14.381907 13809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cc036bb2be47be8b227bb37773a41f" candidate_uuid: "c5d858b6c6b44d579338ca664a99a7d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f74f4405854f6dbad79701d509a7e9"
I20260808 14:41:14.381986 13391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cc036bb2be47be8b227bb37773a41f" candidate_uuid: "c5d858b6c6b44d579338ca664a99a7d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9470a0119c934b16a3150250a9a608d6"
I20260808 14:41:14.381997 13809 raft_consensus.cc:3037] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:14.382054 13391 raft_consensus.cc:3037] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:14.382987 13809 raft_consensus.cc:2454] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d858b6c6b44d579338ca664a99a7d4 in term 1.
I20260808 14:41:14.382987 13391 raft_consensus.cc:2454] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d858b6c6b44d579338ca664a99a7d4 in term 1.
I20260808 14:41:14.383142 13494 leader_election.cc:302] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9470a0119c934b16a3150250a9a608d6, c5d858b6c6b44d579338ca664a99a7d4; no voters:
I20260808 14:41:14.383224 13930 raft_consensus.cc:2781] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:41:14.383335 13930 raft_consensus.cc:686] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 1 LEADER]: Becoming Leader. State: Replica: c5d858b6c6b44d579338ca664a99a7d4, State: Running, Role: LEADER
I20260808 14:41:14.383424 13930 consensus_queue.cc:237] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } }
I20260808 14:41:14.384228 13156 catalog_manager.cc:5495] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d858b6c6b44d579338ca664a99a7d4 (127.29.168.194). New cstate: current_term: 1 leader_uuid: "c5d858b6c6b44d579338ca664a99a7d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d858b6c6b44d579338ca664a99a7d4" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 46419 } health_report { overall_health: HEALTHY } } }
I20260808 14:41:14.455180 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.452964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.29.168.194:46419)
0808 14:41:14.453030 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:14.453033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:14.453053 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:41:14.453098 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:14.453098 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:14.453116 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:14.453191 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:41:14.453302 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.453755 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.454468 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:14.454647 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:14.454719 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:14.454847 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:41:14.454960 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:41:14.455046 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:14.455063 (+ 17us) server_negotiation.cc:299] Negotiation successful
0808 14:41:14.455081 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:41:14.457026 13391 raft_consensus.cc:1261] T 92cc036bb2be47be8b227bb37773a41f P 9470a0119c934b16a3150250a9a608d6 [term 1 FOLLOWER]: Refusing update from remote peer c5d858b6c6b44d579338ca664a99a7d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:41:14.457046 13809 raft_consensus.cc:1261] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 1 FOLLOWER]: Refusing update from remote peer c5d858b6c6b44d579338ca664a99a7d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:41:14.457463 13934 consensus_queue.cc:1035] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9470a0119c934b16a3150250a9a608d6" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 40771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:41:14.457625 13930 consensus_queue.cc:1035] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97f74f4405854f6dbad79701d509a7e9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:41:14.460037 13945 mvcc.cc:205] Tried to move back new op lower bound from 7316275504973299712 to 7316275504674930688. Current Snapshot: MvccSnapshot[applied={T|T < 7316275504973299712}]
I20260808 14:41:14.460222 13941 mvcc.cc:205] Tried to move back new op lower bound from 7316275504973299712 to 7316275504674930688. Current Snapshot: MvccSnapshot[applied={T|T < 7316275504973299712 or (T in {7316275504973299712})}]
I20260808 14:41:14.460953 13942 mvcc.cc:205] Tried to move back new op lower bound from 7316275504973299712 to 7316275504674930688. Current Snapshot: MvccSnapshot[applied={T|T < 7316275504973299712}]
I20260808 14:41:14.461915 13156 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:41:14.462009 13156 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:41:14.462735 13156 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a713bbe081fb4a5da9770d1496bbaace: Sending DeleteTablet for 3 replicas of tablet 92cc036bb2be47be8b227bb37773a41f
I20260808 14:41:14.463076 13577 tablet_service.cc:1514] Processing DeleteTablet for tablet 92cc036bb2be47be8b227bb37773a41f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:41:14 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:37798
I20260808 14:41:14.463104 13782 tablet_service.cc:1514] Processing DeleteTablet for tablet 92cc036bb2be47be8b227bb37773a41f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:41:14 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:44014
I20260808 14:41:14.463267 13356 tablet_service.cc:1514] Processing DeleteTablet for tablet 92cc036bb2be47be8b227bb37773a41f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:41:14 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:40008
I20260808 14:41:14.463382 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 13264
I20260808 14:41:14.470170 13959 tablet_replica.cc:330] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: stopping tablet replica
I20260808 14:41:14.470284 13959 raft_consensus.cc:2229] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:41:14.470388 13959 raft_consensus.cc:2258] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:41:14.470510 13958 tablet_replica.cc:330] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: stopping tablet replica
I20260808 14:41:14.470620 13958 raft_consensus.cc:2229] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:41:14.470721 13958 raft_consensus.cc:2258] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:41:14.471238 13959 ts_tablet_manager.cc:1905] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:41:14.471272 13958 ts_tablet_manager.cc:1905] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:41:14.473328 13959 ts_tablet_manager.cc:1918] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:41:14.473415 13959 log.cc:1196] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/92cc036bb2be47be8b227bb37773a41f
I20260808 14:41:14.473536 13958 ts_tablet_manager.cc:1918] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:41:14.473661 13958 log.cc:1196] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/92cc036bb2be47be8b227bb37773a41f
I20260808 14:41:14.473731 13959 ts_tablet_manager.cc:1939] T 92cc036bb2be47be8b227bb37773a41f P 97f74f4405854f6dbad79701d509a7e9: Deleting consensus metadata
I20260808 14:41:14.473984 13958 ts_tablet_manager.cc:1939] T 92cc036bb2be47be8b227bb37773a41f P c5d858b6c6b44d579338ca664a99a7d4: Deleting consensus metadata
I20260808 14:41:14.474184 13137 catalog_manager.cc:4841] TS 97f74f4405854f6dbad79701d509a7e9 (127.29.168.195:42937): tablet 92cc036bb2be47be8b227bb37773a41f (table test-table [id=8b59c628906e4e4c928a1cc071b1542f]) successfully deleted
I20260808 14:41:14.474422 13134 catalog_manager.cc:4841] TS c5d858b6c6b44d579338ca664a99a7d4 (127.29.168.194:46419): tablet 92cc036bb2be47be8b227bb37773a41f (table test-table [id=8b59c628906e4e4c928a1cc071b1542f]) successfully deleted
W20260808 14:41:14.475852 13135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:40771 (error 108)
I20260808 14:41:14.476048 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 13470
I20260808 14:41:14.484548 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:14.479142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:40771 (local address 127.0.0.1:40012)
0808 14:41:14.484458 (+ 5316us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:14.484508 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:40771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5286}
W20260808 14:41:14.484810 13135 catalog_manager.cc:4584] TS 9470a0119c934b16a3150250a9a608d6 (127.29.168.193:40771): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 92cc036bb2be47be8b227bb37773a41f: Network error: Client connection negotiation failed: client connection to 127.29.168.193:40771: connect: Connection refused (error 111)
I20260808 14:41:14.489526 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 13688
I20260808 14:41:14.498134 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 13100
2026-08-08T14:41:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2345 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:41:14 dist-test-slave-mjjr krb5kdc[13964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:41:14 dist-test-slave-mjjr krb5kdc[13964](info): set up 2 sockets
Aug 08 14:41:14 dist-test-slave-mjjr krb5kdc[13964](info): commencing operation
krb5kdc: starting...
W20260808 14:41:15.682252 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:41:15 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:41:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:41:15Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/rangeradmin_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/rangeradmin_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/rangerlookup_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/rangerlookup_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
I20260808 14:41:15.828533 30371 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskniu_ne/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/postgres -l logfile start
2026-08-08 14:41:18.117 UTC [14015] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:41:18.118 UTC [14015] LOG: listening on IPv4 address "127.29.168.212", port 43817
2026-08-08 14:41:18.121 UTC [14015] LOG: listening on Unix socket "/tmp/.s.PGSQL.43817"
2026-08-08 14:41:18.141 UTC [14020] LOG: database system was shut down at 2026-08-08 14:41:16 UTC
2026-08-08 14:41:18.145 UTC [14015] LOG: database system is ready to accept connections
I20260808 14:41:19.235351 30371 mini_postgres.cc:96] Postgres bound to 43817
2026-08-08 14:41:19.243 UTC [14044] FATAL: database "slave" does not exist
127.29.168.212:43817 - accepting connections
I20260808 14:41:19.244127 30371 mini_ranger.cc:161] Starting Ranger...
I20260808 14:41:19.260179 30371 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:41:19.677973 30371 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:41:19.678064 30371 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-admin
2026-08-08 14:41:20,029 [I] DB FLAVOR :POSTGRES
2026-08-08 14:41:20,030 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:41:20,030 [I] Checking connection..
2026-08-08 14:41:20,030 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:41:20,287 [I] Checking connection passed.
2026-08-08 14:41:20,287 [I] --------- Verifying version history table ---------
2026-08-08 14:41:20,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:41:20,523 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:41:20,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:41:20,751 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:41:20,751 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:41:20,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:41:21.001 UTC [14149] WARNING: there is no transaction in progress
2026-08-08 14:41:21,007 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:41:21,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:41:21,265 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:41:21,266 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:41:21,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:41:21,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:41:21,741 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-mjjr.c.gcp-upstream.internal','N') ;"
2026-08-08 14:41:21,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:41:22,243 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:41:22,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:41:22,485 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:41:22,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:41:22,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:41:22,963 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:41:22,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:41:23.853 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.871 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.886 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.899 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.913 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.928 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.983 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:23.989 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.001 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.010 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.019 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.032 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.040 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.045 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.051 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24.057 UTC [14316] WARNING: there is no transaction in progress
2026-08-08 14:41:24,622 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:41:24,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:41:24,883 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:41:24,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:41:25,135 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:41:25,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:41:25,392 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:41:25,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:41:25,640 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:41:25,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-mjjr.c.gcp-upstream.internal';"
2026-08-08 14:41:26,155 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:41:26,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:41:26,412 [I] DB_PATCHES have already been applied
I20260808 14:41:26.417721 30371 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-admin:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskniu_ne/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:41:26.417783 30371 mini_ranger.cc:193] Using host: 127.29.168.212
I20260808 14:41:26.421777 30371 mini_ranger.cc:227] Ranger admin URL: http://127.29.168.212:39201
Aug 08, 2026 2:41:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:41:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:41:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:41:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:41:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:41:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:41:27 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:41:27.698076 30371 mini_ranger.cc:160] Time spent starting Ranger: real 8.454s user 0.000s sys 0.011s
Aug 08, 2026 2:41:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:41:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:41:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:41:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:41:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:41:48.241945 30371 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/rangerkms_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/rangerkms_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.168.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.168.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:41:48 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200108, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:41:48.336012 30371 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:41:48.346585 30371 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:41:49.085062 30371 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:41:49.085144 30371 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms
I20260808 14:41:49.085165 30371 mini_ranger_kms.cc:227] Using postgres at 127.29.168.212:43817
2026-08-08 14:41:49,353 [I] DB FLAVOR :POSTGRES
2026-08-08 14:41:49,353 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:41:49,354 [I] Checking connection
2026-08-08 14:41:49,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:41:49,591 [I] connection success
2026-08-08 14:41:49,591 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:41:49,592 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:41:49,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:41:49,820 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:41:49,820 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:41:49,821 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:41:49,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:43817/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:41:50,093 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:41:50.538978 30371 mini_ranger_kms.cc:310] Created kms service
I20260808 14:41:50.711670 30371 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:41:50.752194 30371 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:41:50 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200108, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:41:51.129606 30371 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:41:51.129732 30371 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms:/tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:41:51.129760 30371 mini_ranger_kms.cc:240] Using host: 127.29.168.212
I20260808 14:41:51.134047 30371 mini_ranger_kms.cc:276] Ranger KMS PID: 14640
I20260808 14:41:51.134179 30371 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.168.212:48131
Aug 08, 2026 2:41:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:41:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:41:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:41:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:41:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:41:52 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:41:53 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200113, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.168.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:53.726315 30371 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.390s user 0.007s sys 0.245s
I20260808 14:41:53.726426 30371 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:41:53.726541 30371 mini_ranger_kms.cc:401] 127.29.168.212:48131/kms/v1/keys
Aug 08 14:41:54 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200113, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.168.212@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
Aug 08 14:41:54 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200113, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.168.212@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
Aug 08 14:41:56 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:41:56.527845 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39183
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:39183
--ranger_config_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:48131/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:56.616782 14720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:56.616972 14720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:56.616991 14720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:56.618140 14720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:41:56.618182 14720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:56.618196 14720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:56.618208 14720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:41:56.618220 14720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:41:56.619930 14720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.168.212:48131/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:39183
--ranger_config_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:56.620163 14720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:56.620399 14720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:56.626310 14735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:56.626358 14739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:56.626346 14734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:56.626552 14720 server_base.cc:1034] running on GCE node
I20260808 14:41:56.626780 14720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:56.627132 14720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:56.628280 14720 hybrid_clock.cc:648] HybridClock initialized: now 1786200116628259 us; error 38 us; skew 500 ppm
Aug 08 14:41:56 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200116, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:56.630795 14720 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:41:56.631294 14720 webserver.cc:460] Webserver started at http://127.29.168.254:35909/ using document root <none> and password file <none>
I20260808 14:41:56.631524 14720 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:56.631560 14720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:56.631703 14720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:41:56 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200116, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:41:56.689723 14720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "0e1e9e376bfa43b1b9787b9338188f00"
format_stamp: "Formatted at 2026-08-08 14:41:56 on dist-test-slave-mjjr"
server_key: "1065d2c2d5c204f650b90fbc072a7ebf"
server_key_iv: "709dd7f4043fa626681de4c44baa57b2"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:56.690182 14720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "0e1e9e376bfa43b1b9787b9338188f00"
format_stamp: "Formatted at 2026-08-08 14:41:56 on dist-test-slave-mjjr"
server_key: "1065d2c2d5c204f650b90fbc072a7ebf"
server_key_iv: "709dd7f4043fa626681de4c44baa57b2"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:56.691958 14720 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260808 14:41:56.705546 14750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:56.705701 14720 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:41:56.705802 14720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "0e1e9e376bfa43b1b9787b9338188f00"
format_stamp: "Formatted at 2026-08-08 14:41:56 on dist-test-slave-mjjr"
server_key: "1065d2c2d5c204f650b90fbc072a7ebf"
server_key_iv: "709dd7f4043fa626681de4c44baa57b2"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:56.705890 14720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:56.716305 14720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:56.718253 14720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:56.718395 14720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:56.726356 14720 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:39183
I20260808 14:41:56.726393 14830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:39183 every 8 connection(s)
I20260808 14:41:56.726774 14720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:41:56.727561 14831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:56.730135 14831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00: Bootstrap starting.
I20260808 14:41:56.731089 14831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:56.731734 14831 log.cc:824] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:56.732590 14831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00: No bootstrap required, opened a new log
I20260808 14:41:56.733937 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 14720
I20260808 14:41:56.734043 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:41:56.734246 30371 external_mini_cluster.cc:1428] Setting key 3a4ff8e8ffe82edc7a9325962d005495
I20260808 14:41:56.736761 14831 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e1e9e376bfa43b1b9787b9338188f00" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39183 } }
I20260808 14:41:56.736940 14831 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:56.736999 14831 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1e9e376bfa43b1b9787b9338188f00, State: Initialized, Role: FOLLOWER
I20260808 14:41:56.737160 14831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e1e9e376bfa43b1b9787b9338188f00" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39183 } }
I20260808 14:41:56.737289 14831 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:41:56.737325 14831 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:41:56.737401 14831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:56.738348 14831 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e1e9e376bfa43b1b9787b9338188f00" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39183 } }
I20260808 14:41:56.738461 14831 leader_election.cc:302] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e1e9e376bfa43b1b9787b9338188f00; no voters:
I20260808 14:41:56.738662 14831 leader_election.cc:288] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:41:56.738693 14837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:41:56.738907 14837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [term 1 LEADER]: Becoming Leader. State: Replica: 0e1e9e376bfa43b1b9787b9338188f00, State: Running, Role: LEADER
I20260808 14:41:56.738986 14831 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:41:56.739025 14837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e1e9e376bfa43b1b9787b9338188f00" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39183 } }
I20260808 14:41:56.741199 14840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e1e9e376bfa43b1b9787b9338188f00. Latest consensus state: current_term: 1 leader_uuid: "0e1e9e376bfa43b1b9787b9338188f00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e1e9e376bfa43b1b9787b9338188f00" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39183 } } }
I20260808 14:41:56.741281 14840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:56.741529 14831 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:41:56.741549 14837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e1e9e376bfa43b1b9787b9338188f00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e1e9e376bfa43b1b9787b9338188f00" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39183 } } }
I20260808 14:41:56.742374 14837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00 [sys.catalog]: This master's current role is: LEADER
I20260808 14:41:56.742545 14862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:41:56.743297 14862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:41:56 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:56.747434 14862 catalog_manager.cc:1347] Generated new cluster ID: 88494d2dcb954a7f97f72b0532497e58
I20260808 14:41:56.747484 14862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:41:56.749882 14836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:56.734841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47052 (local address 127.29.168.254:39183)
0808 14:41:56.735176 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:56.735184 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:56.735215 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:41:56.736776 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:56.736785 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:56.736869 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:56.737024 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:56.738014 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:56.739419 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:56.740830 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:56.741723 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:56.741869 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:56.745027 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:56.745031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:56.745032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:56.745043 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:56.747547 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:56.747977 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:56.747980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:56.747980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:56.748082 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:56.748269 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:56.748269 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:56.748270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:56.748531 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:56.748775 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:56.749263 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 14:41:56.749368 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":198,"threads_started":1}
I20260808 14:41:56.767689 14862 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:41:56.768457 14862 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:41:56.776608 14862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00: Generated new TSK 0
I20260808 14:41:56.776993 14862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:41:57.466159 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:48131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39183
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:57.561738 14905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:57.561955 14905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:57.561991 14905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:57.563077 14905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:57.563175 14905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:57.563230 14905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:41:57.564725 14905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.168.212:48131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:57.564978 14905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:57.565208 14905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:57.570334 14912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:57.570590 14914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:57.570689 14917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:57.570984 14905 server_base.cc:1034] running on GCE node
I20260808 14:41:57.571197 14905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:57.571468 14905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:57.572618 14905 hybrid_clock.cc:648] HybridClock initialized: now 1786200117572586 us; error 51 us; skew 500 ppm
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:57.575289 14905 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:41:57.575770 14905 webserver.cc:460] Webserver started at http://127.29.168.193:39617/ using document root <none> and password file <none>
I20260808 14:41:57.576030 14905 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:57.576102 14905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:57.576246 14905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:41:57.589602 14905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "bc0c3c893e6a4c0b844d586a9d99793f"
format_stamp: "Formatted at 2026-08-08 14:41:57 on dist-test-slave-mjjr"
server_key: "da1ca07b609c487e17d5e7fa77271d92"
server_key_iv: "00992997ae11c96913855d238d9c521c"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:57.590022 14905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "bc0c3c893e6a4c0b844d586a9d99793f"
format_stamp: "Formatted at 2026-08-08 14:41:57 on dist-test-slave-mjjr"
server_key: "da1ca07b609c487e17d5e7fa77271d92"
server_key_iv: "00992997ae11c96913855d238d9c521c"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:57.591965 14905 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:41:57.603433 14931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:57.603626 14905 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:41:57.603730 14905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "bc0c3c893e6a4c0b844d586a9d99793f"
format_stamp: "Formatted at 2026-08-08 14:41:57 on dist-test-slave-mjjr"
server_key: "da1ca07b609c487e17d5e7fa77271d92"
server_key_iv: "00992997ae11c96913855d238d9c521c"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:57.603807 14905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:57.621357 14905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:57.623407 14905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:57.623559 14905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:57.623824 14905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:57.624183 14905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:57.624234 14905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:57.624294 14905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:57.624336 14905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:57.632818 14905 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:44103
I20260808 14:41:57.633172 14905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:41:57.633746 15115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:44103 every 8 connection(s)
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:57.641891 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 14905
I20260808 14:41:57.642019 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:41:57.642204 30371 external_mini_cluster.cc:1428] Setting key f0368a514ab662543dffcdd05d0d37b8
I20260808 14:41:57.645052 15118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:57.634014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39183 (local address 127.29.168.193:34381)
0808 14:41:57.635836 (+ 1822us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:57.635881 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:57.636530 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:57.636900 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:57.636904 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:57.637111 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:57.637276 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:57.637280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.637989 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.637990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:57.638762 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:57.638764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.639166 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.639167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:57.639371 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:57.639984 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:57.639993 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:57.641336 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:57.643412 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:57.643419 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:57.643421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:57.643760 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:57.643986 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:57.643986 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:57.643987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:57.644127 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:57.644450 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:57.644457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:57.644618 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 14:41:57.644707 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:41:57.644879 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1780,"thread_start_us":72,"threads_started":1}
I20260808 14:41:57.645455 15119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:57.634045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:34381 (local address 127.29.168.254:39183)
0808 14:41:57.635766 (+ 1721us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:57.635768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:57.636670 (+ 902us) server_negotiation.cc:407] Connection header received
0808 14:41:57.636701 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:57.636702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:57.636715 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:57.636774 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:57.637406 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.637900 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.638846 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.639061 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.639155 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:57.641424 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:57.641426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:57.641426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:57.641433 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:57.643328 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:57.643852 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:57.643854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:57.643854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:57.643921 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:57.644208 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:57.644209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:57.644209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:57.644353 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:57.644424 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:57.645289 (+ 865us) server_negotiation.cc:299] Negotiation successful
0808 14:41:57.645369 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1686,"thread_start_us":93,"threads_started":1}
I20260808 14:41:57.645884 15116 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39183
I20260808 14:41:57.645972 15116 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:57.646145 15116 heartbeater.cc:511] Master 127.29.168.254:39183 requested a full tablet report, sending...
I20260808 14:41:57.646656 14778 ts_manager.cc:194] Registered new tserver with Master: bc0c3c893e6a4c0b844d586a9d99793f (127.29.168.193:44103)
I20260808 14:41:57.647248 14778 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:34381
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:41:57.682494 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:48131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39183
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:57.792301 15129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:57.792536 15129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:57.792567 15129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:57.794100 15129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:57.794152 15129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:57.794186 15129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:41:57.796123 15129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.168.212:48131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:57.796339 15129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:57.796624 15129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:57.803202 15147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:57.803546 15129 server_base.cc:1034] running on GCE node
W20260808 14:41:57.803282 15144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:57.803704 15139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:57.803990 15129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:57.804224 15129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:57.805392 15129 hybrid_clock.cc:648] HybridClock initialized: now 1786200117805363 us; error 42 us; skew 500 ppm
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:57.808787 15129 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:41:57.809319 15129 webserver.cc:460] Webserver started at http://127.29.168.194:42011/ using document root <none> and password file <none>
I20260808 14:41:57.809624 15129 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:57.809702 15129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:57.809882 15129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:41:57.824198 15129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "c492201c172042d1adea5f76da8b6691"
format_stamp: "Formatted at 2026-08-08 14:41:57 on dist-test-slave-mjjr"
server_key: "27b69012cb1586b5c80b98d91fb2e4c7"
server_key_iv: "3fea340262f43b815feaf217c7a604f5"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:57.824596 15129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "c492201c172042d1adea5f76da8b6691"
format_stamp: "Formatted at 2026-08-08 14:41:57 on dist-test-slave-mjjr"
server_key: "27b69012cb1586b5c80b98d91fb2e4c7"
server_key_iv: "3fea340262f43b815feaf217c7a604f5"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:57.826402 15129 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:41:57.838090 15158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:57.838305 15129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:41:57.838397 15129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "c492201c172042d1adea5f76da8b6691"
format_stamp: "Formatted at 2026-08-08 14:41:57 on dist-test-slave-mjjr"
server_key: "27b69012cb1586b5c80b98d91fb2e4c7"
server_key_iv: "3fea340262f43b815feaf217c7a604f5"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:57.838471 15129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:57.855315 15129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:57.857692 15129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:57.857900 15129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:57.858129 15129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:57.858481 15129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:57.858534 15129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:57.858562 15129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:57.858580 15129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:57.869397 15129 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:32975
I20260808 14:41:57.872711 15129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:41:57.874315 15359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:32975 every 8 connection(s)
I20260808 14:41:57.881916 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 15129
I20260808 14:41:57.882036 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:41:57.882257 30371 external_mini_cluster.cc:1428] Setting key 0d9cba38e13fac9fe221b2f33598ceed
Aug 08 14:41:57 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:57.886803 15119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:57.875058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:43843 (local address 127.29.168.254:39183)
0808 14:41:57.875113 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:57.875115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:57.875322 (+ 207us) server_negotiation.cc:407] Connection header received
0808 14:41:57.876032 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:57.876033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:57.876047 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:57.876077 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:57.877156 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.878088 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.880030 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.880342 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.880389 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:57.883784 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:57.883785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:57.883785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:57.883801 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:57.885325 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:57.885763 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:57.885764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:57.885764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:57.885829 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:57.886074 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:57.886075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:57.886076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:57.886198 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:57.886246 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:57.886615 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 14:41:57.886701 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:41:57.887395 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:57.874717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39183 (local address 127.29.168.194:43843)
0808 14:41:57.875186 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:57.875234 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:57.875901 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:57.876238 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:57.876242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:57.876589 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:57.877050 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:57.877056 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.878273 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.878274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:57.879927 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:57.879930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:57.880478 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:57.880479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:57.880672 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:57.881340 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:57.881350 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:57.883689 (+ 2339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:57.885414 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:57.885420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:57.885422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:57.885669 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:57.885892 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:57.885893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:57.885893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:57.886006 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:57.886277 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:57.886282 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:57.886425 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:41:57.886896 (+ 471us) client_negotiation.cc:240] Negotiation successful
0808 14:41:57.887048 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":137,"threads_started":1}
I20260808 14:41:57.888244 15361 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39183
I20260808 14:41:57.888360 15361 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:57.888522 15361 heartbeater.cc:511] Master 127.29.168.254:39183 requested a full tablet report, sending...
I20260808 14:41:57.888895 14778 ts_manager.cc:194] Registered new tserver with Master: c492201c172042d1adea5f76da8b6691 (127.29.168.194:32975)
I20260808 14:41:57.889349 14778 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:43843
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:41:57.920269 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:48131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39183
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:41:58.044638 15369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:41:58.044983 15369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:41:58.045086 15369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:41:58.046758 15369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:41:58.046872 15369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:41:58.046973 15369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:41:58.048777 15369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.168.212:48131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:41:58.049134 15369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:41:58.049470 15369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:41:58.055325 15391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:41:58.055428 15384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:58.055763 15369 server_base.cc:1034] running on GCE node
W20260808 14:41:58.057260 15387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:41:58.057617 15369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:41:58.057925 15369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:41:58.059106 15369 hybrid_clock.cc:648] HybridClock initialized: now 1786200118059087 us; error 35 us; skew 500 ppm
Aug 08 14:41:58 dist-test-slave-mjjr krb5kdc[13964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200118, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:41:58.062903 15369 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:41:58.063295 15369 webserver.cc:460] Webserver started at http://127.29.168.195:41659/ using document root <none> and password file <none>
I20260808 14:41:58.063524 15369 fs_manager.cc:359] Metadata directory not provided
I20260808 14:41:58.063588 15369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:41:58.063781 15369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:41:58 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200118, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:41:58.077564 15369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "69ee40e5fa84450287df8b9bdcf9a84d"
format_stamp: "Formatted at 2026-08-08 14:41:58 on dist-test-slave-mjjr"
server_key: "c640aeb793d358360765541995da989f"
server_key_iv: "7b43801cc2c6c44604edda45aafeef68"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:58.078083 15369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "69ee40e5fa84450287df8b9bdcf9a84d"
format_stamp: "Formatted at 2026-08-08 14:41:58 on dist-test-slave-mjjr"
server_key: "c640aeb793d358360765541995da989f"
server_key_iv: "7b43801cc2c6c44604edda45aafeef68"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:58.084544 15369 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260808 14:41:58.102905 15404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:58.103256 15369 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260808 14:41:58.103380 15369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "69ee40e5fa84450287df8b9bdcf9a84d"
format_stamp: "Formatted at 2026-08-08 14:41:58 on dist-test-slave-mjjr"
server_key: "c640aeb793d358360765541995da989f"
server_key_iv: "7b43801cc2c6c44604edda45aafeef68"
server_key_version: "kuduclusterkey@0"
I20260808 14:41:58.103466 15369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:41:58.149219 15369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:41:58.152382 15369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:41:58.152700 15369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:41:58.153100 15369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:41:58.153683 15369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:41:58.153842 15369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:58.153930 15369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:41:58.154007 15369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:41:58.174357 15369 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:34939
I20260808 14:41:58.175169 15369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:41:58.176935 15587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:34939 every 8 connection(s)
I20260808 14:41:58.178975 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 15369
I20260808 14:41:58.179090 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:41:58.179283 30371 external_mini_cluster.cc:1428] Setting key ec6a849db9f9721c2d4f7e33bff0b2b5
Aug 08 14:41:58 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200118, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:41:58.188050 15119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.176465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:35875 (local address 127.29.168.254:39183)
0808 14:41:58.176528 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.176530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.177678 (+ 1148us) server_negotiation.cc:407] Connection header received
0808 14:41:58.178784 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.178785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.178816 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.178860 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:58.180172 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.181114 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.182232 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.182444 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.182536 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.185154 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:58.185156 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:58.185156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:58.185164 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:58.186597 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:58.187019 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:58.187020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:58.187021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:58.187081 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:58.187342 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:58.187343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:58.187344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:58.187455 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:58.187529 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.187883 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.187966 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:41:58.188266 15591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.176113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39183 (local address 127.29.168.195:35875)
0808 14:41:58.177467 (+ 1354us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.177552 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:58.178634 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:58.179141 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:58.179145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:58.179611 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:41:58.180053 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.180060 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.181252 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.181253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.182118 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.182121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.182544 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.182545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.182718 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.183308 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:41:58.183317 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:41:58.185063 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:41:58.186700 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:58.186707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:58.186710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:58.186939 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:58.187165 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:41:58.187166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:41:58.187166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:41:58.187272 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:41:58.187530 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:41:58.187537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:41:58.187739 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 14:41:58.187847 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:41:58.187974 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1304,"thread_start_us":154,"threads_started":1}
I20260808 14:41:58.188670 15588 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39183
I20260808 14:41:58.188755 15588 heartbeater.cc:464] Registering TS with master...
I20260808 14:41:58.188988 15588 heartbeater.cc:511] Master 127.29.168.254:39183 requested a full tablet report, sending...
I20260808 14:41:58.189357 14778 ts_manager.cc:194] Registered new tserver with Master: 69ee40e5fa84450287df8b9bdcf9a84d (127.29.168.195:34939)
I20260808 14:41:58.189726 14778 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:35875
I20260808 14:41:58.190897 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:41:58.198987 15119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.192537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47056 (local address 127.29.168.254:39183)
0808 14:41:58.192571 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.192573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.192808 (+ 235us) server_negotiation.cc:407] Connection header received
0808 14:41:58.192870 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.192871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.192881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.192925 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:41:58.193573 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.194024 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.194753 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.194954 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.195028 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.196284 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:41:58.196285 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:41:58.196285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:41:58.196293 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:41:58.197720 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:58.198072 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:58.198074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:58.198074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:58.198140 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:41:58.198340 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:41:58.198341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:41:58.198341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:41:58.198465 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:41:58.198584 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.198776 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.198884 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:41:58.200881 14778 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:41:58.202580 14778 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:41:58.210806 15606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.205354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:34939 (local address 127.0.0.1:59070)
0808 14:41:58.205783 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.205836 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:58.206196 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:58.206919 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:58.206920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:58.206922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:58.206966 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.206967 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.208274 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.208274 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.209391 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.209392 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.210473 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.210474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.210555 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.210569 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:41:58.210640 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:41:58.210696 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":71,"threads_started":1}
I20260808 14:41:58.211192 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.205485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59070 (local address 127.29.168.195:34939)
0808 14:41:58.206649 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.206653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.206663 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:41:58.206716 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.206718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.206733 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.206812 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:58.207040 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.208189 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.209569 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.210385 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.210491 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.210548 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.211070 (+ 522us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.211107 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1053,"thread_start_us":166,"threads_started":1}
I20260808 14:41:58.212072 15613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.205409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:44103 (local address 127.0.0.1:53976)
0808 14:41:58.205892 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.205901 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:58.205958 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:58.206254 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:58.206257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:58.206259 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:58.206335 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.206336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.207958 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.207959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.209290 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.209293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.211562 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.211563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.211740 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.211746 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:41:58.211841 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:41:58.211940 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":29,"thread_start_us":84,"threads_started":1}
I20260808 14:41:58.212088 15487 tablet_service.cc:1467] Processing CreateTablet for tablet 54d7fa552d974010922de7ea8b30fc23 (DEFAULT_TABLE table=test-table [id=2fb9b56a833a4db99a335e90405dd798]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:41:58.212388 15614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.205669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53976 (local address 127.29.168.193:44103)
0808 14:41:58.205840 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.205844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.206046 (+ 202us) server_negotiation.cc:407] Connection header received
0808 14:41:58.206084 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.206087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.206106 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.206180 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:58.206415 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.207867 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.209396 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.211252 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.211399 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.211491 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.212247 (+ 756us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.212302 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":65,"threads_started":1}
I20260808 14:41:58.212487 15487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d7fa552d974010922de7ea8b30fc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:58.213136 14981 tablet_service.cc:1467] Processing CreateTablet for tablet 54d7fa552d974010922de7ea8b30fc23 (DEFAULT_TABLE table=test-table [id=2fb9b56a833a4db99a335e90405dd798]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:41:58.213472 14981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d7fa552d974010922de7ea8b30fc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:58.214604 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.205562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:32975 (local address 127.0.0.1:43518)
0808 14:41:58.206116 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.206128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:58.206184 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:58.210865 (+ 4681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:58.210866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:58.210869 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:58.210910 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.210912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.212162 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.212163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.213271 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.213274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.214343 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.214344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.214401 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.214404 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:41:58.214455 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:41:58.214490 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":120,"threads_started":1}
I20260808 14:41:58.214895 15615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.205860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43518 (local address 127.29.168.194:32975)
0808 14:41:58.210645 (+ 4785us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.210649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.210659 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:41:58.210697 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.210699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.210713 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.210783 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:58.210988 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.212064 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.213410 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.214101 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.214224 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.214287 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.214760 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.214801 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4744,"thread_start_us":126,"threads_started":1}
I20260808 14:41:58.215552 15241 tablet_service.cc:1467] Processing CreateTablet for tablet 54d7fa552d974010922de7ea8b30fc23 (DEFAULT_TABLE table=test-table [id=2fb9b56a833a4db99a335e90405dd798]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:41:58.215931 15241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d7fa552d974010922de7ea8b30fc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:41:58.217026 15617 tablet_bootstrap.cc:492] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Bootstrap starting.
I20260808 14:41:58.218168 15617 tablet_bootstrap.cc:654] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:58.218809 15617 log.cc:824] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:58.219272 15618 tablet_bootstrap.cc:492] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: Bootstrap starting.
I20260808 14:41:58.220250 15617 tablet_bootstrap.cc:492] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: No bootstrap required, opened a new log
I20260808 14:41:58.220428 15617 ts_tablet_manager.cc:1397] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:41:58.221007 15618 tablet_bootstrap.cc:654] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:58.221822 15618 log.cc:824] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:58.222805 15618 tablet_bootstrap.cc:492] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: No bootstrap required, opened a new log
I20260808 14:41:58.222903 15618 ts_tablet_manager.cc:1397] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260808 14:41:58.223881 15620 tablet_bootstrap.cc:492] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Bootstrap starting.
I20260808 14:41:58.225391 15620 tablet_bootstrap.cc:654] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Neither blocks nor log segments found. Creating new log.
I20260808 14:41:58.225394 15617 raft_consensus.cc:348] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.225922 15617 raft_consensus.cc:374] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:58.226120 15617 raft_consensus.cc:729] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ee40e5fa84450287df8b9bdcf9a84d, State: Initialized, Role: FOLLOWER
I20260808 14:41:58.226457 15617 consensus_queue.cc:260] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.226588 15620 log.cc:824] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Log is configured to *not* fsync() on all Append() calls
I20260808 14:41:58.227205 15617 ts_tablet_manager.cc:1428] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260808 14:41:58.227242 15618 raft_consensus.cc:348] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.227423 15618 raft_consensus.cc:374] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:58.227468 15588 heartbeater.cc:503] Master 127.29.168.254:39183 was elected leader, sending a full tablet report...
I20260808 14:41:58.227468 15618 raft_consensus.cc:729] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0c3c893e6a4c0b844d586a9d99793f, State: Initialized, Role: FOLLOWER
I20260808 14:41:58.227605 15618 consensus_queue.cc:260] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.227991 15618 ts_tablet_manager.cc:1428] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 14:41:58.228652 15116 heartbeater.cc:503] Master 127.29.168.254:39183 was elected leader, sending a full tablet report...
I20260808 14:41:58.228729 15620 tablet_bootstrap.cc:492] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: No bootstrap required, opened a new log
I20260808 14:41:58.228834 15620 ts_tablet_manager.cc:1397] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:41:58.231734 15620 raft_consensus.cc:348] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.231894 15620 raft_consensus.cc:374] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:41:58.231942 15620 raft_consensus.cc:729] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c492201c172042d1adea5f76da8b6691, State: Initialized, Role: FOLLOWER
I20260808 14:41:58.232053 15620 consensus_queue.cc:260] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.232398 15620 ts_tablet_manager.cc:1428] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 14:41:58.232532 15361 heartbeater.cc:503] Master 127.29.168.254:39183 was elected leader, sending a full tablet report...
Aug 08 14:41:58 dist-test-slave-mjjr krb5kdc[13964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
W20260808 14:41:58.375563 15363 tablet.cc:2369] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:41:58.382210 15625 raft_consensus.cc:482] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:41:58.382360 15625 raft_consensus.cc:504] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.382782 15625 leader_election.cc:288] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ee40e5fa84450287df8b9bdcf9a84d (127.29.168.195:34939), c492201c172042d1adea5f76da8b6691 (127.29.168.194:32975)
W20260808 14:41:58.386233 15117 tablet.cc:2369] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:41:58.388496 15615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.383860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:46937 (local address 127.29.168.194:32975)
0808 14:41:58.383919 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.383921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.384387 (+ 466us) server_negotiation.cc:407] Connection header received
0808 14:41:58.384479 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.384481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.384497 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.384559 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:58.384917 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.385643 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.387341 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.388039 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.388086 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.388097 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.388388 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.388432 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:41:58.388746 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.383461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:32975 (local address 127.29.168.193:46937)
0808 14:41:58.384327 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.384336 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:58.384396 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:58.384613 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:58.384615 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:58.384617 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:58.384834 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.384836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.385876 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.385877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.387221 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.387224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.388160 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.388161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.388294 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.388298 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:41:58.388589 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 14:41:58.388637 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":497,"threads_started":1}
I20260808 14:41:58.389398 15270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7fa552d974010922de7ea8b30fc23" candidate_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c492201c172042d1adea5f76da8b6691" is_pre_election: true
I20260808 14:41:58.389564 15270 raft_consensus.cc:2454] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0c3c893e6a4c0b844d586a9d99793f in term 0.
I20260808 14:41:58.389647 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.383804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:60131 (local address 127.29.168.195:34939)
0808 14:41:58.383918 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.383920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.384236 (+ 316us) server_negotiation.cc:407] Connection header received
0808 14:41:58.384602 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.384603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.384617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.384650 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:41:58.385055 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.385830 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.388437 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.388982 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.389044 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.389051 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.389522 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.389565 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 14:41:58.390093 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.383115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:34939 (local address 127.29.168.193:60131)
0808 14:41:58.384153 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.384165 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:41:58.384509 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:41:58.384718 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:41:58.384719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:41:58.384720 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:41:58.384955 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.384958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.386928 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.386929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.388318 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:41:58.388321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.389290 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.389291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:41:58.389407 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.389411 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:41:58.389772 (+ 361us) client_negotiation.cc:240] Negotiation successful
0808 14:41:58.389821 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1006,"mutex_wait_us":50,"thread_start_us":205,"threads_started":1}
I20260808 14:41:58.390100 14932 leader_election.cc:302] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0c3c893e6a4c0b844d586a9d99793f, c492201c172042d1adea5f76da8b6691; no voters:
I20260808 14:41:58.390280 15625 raft_consensus.cc:2781] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:41:58.390348 15625 raft_consensus.cc:482] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:41:58.390374 15625 raft_consensus.cc:3037] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:58.391824 15625 raft_consensus.cc:504] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.391963 15625 leader_election.cc:288] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [CANDIDATE]: Term 1 election: Requested vote from peers 69ee40e5fa84450287df8b9bdcf9a84d (127.29.168.195:34939), c492201c172042d1adea5f76da8b6691 (127.29.168.194:32975)
I20260808 14:41:58.392376 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7fa552d974010922de7ea8b30fc23" candidate_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" is_pre_election: true
I20260808 14:41:58.392529 15511 raft_consensus.cc:2454] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0c3c893e6a4c0b844d586a9d99793f in term 0.
I20260808 14:41:58.392693 15270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7fa552d974010922de7ea8b30fc23" candidate_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c492201c172042d1adea5f76da8b6691"
I20260808 14:41:58.392779 15270 raft_consensus.cc:3037] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:58.393935 15270 raft_consensus.cc:2454] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0c3c893e6a4c0b844d586a9d99793f in term 1.
I20260808 14:41:58.394273 14932 leader_election.cc:302] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0c3c893e6a4c0b844d586a9d99793f, c492201c172042d1adea5f76da8b6691; no voters:
I20260808 14:41:58.394361 15625 raft_consensus.cc:2781] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:41:58.394354 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d7fa552d974010922de7ea8b30fc23" candidate_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ee40e5fa84450287df8b9bdcf9a84d"
I20260808 14:41:58.394472 15511 raft_consensus.cc:3037] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:41:58.394618 15625 raft_consensus.cc:686] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [term 1 LEADER]: Becoming Leader. State: Replica: bc0c3c893e6a4c0b844d586a9d99793f, State: Running, Role: LEADER
I20260808 14:41:58.394708 15625 consensus_queue.cc:237] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } }
I20260808 14:41:58.395785 15511 raft_consensus.cc:2454] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0c3c893e6a4c0b844d586a9d99793f in term 1.
I20260808 14:41:58.395714 14778 catalog_manager.cc:5495] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f reported cstate change: term changed from 0 to 1, leader changed from <none> to bc0c3c893e6a4c0b844d586a9d99793f (127.29.168.193). New cstate: current_term: 1 leader_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0c3c893e6a4c0b844d586a9d99793f" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44103 } health_report { overall_health: HEALTHY } } }
W20260808 14:41:58.427495 15590 tablet.cc:2369] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:41:58.437366 15614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.433843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.29.168.193:44103)
0808 14:41:58.433894 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:41:58.433897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:41:58.433911 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:41:58.433988 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:41:58.433989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:41:58.434026 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:41:58.434117 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:41:58.434284 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.435014 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.436161 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:41:58.436466 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:41:58.436531 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:41:58.436734 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:41:58.436857 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:41:58.436932 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:41:58.437167 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 14:41:58.437188 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:41:58.439677 15270 raft_consensus.cc:1261] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 1 FOLLOWER]: Refusing update from remote peer bc0c3c893e6a4c0b844d586a9d99793f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:41:58.440201 15630 consensus_queue.cc:1035] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c492201c172042d1adea5f76da8b6691" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:41:58.442935 15511 raft_consensus.cc:1261] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 1 FOLLOWER]: Refusing update from remote peer bc0c3c893e6a4c0b844d586a9d99793f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:41:58.443341 15630 consensus_queue.cc:1035] T 54d7fa552d974010922de7ea8b30fc23 P bc0c3c893e6a4c0b844d586a9d99793f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ee40e5fa84450287df8b9bdcf9a84d" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 34939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:41:58.447283 15637 mvcc.cc:205] Tried to move back new op lower bound from 7316275685125181440 to 7316275684945256448. Current Snapshot: MvccSnapshot[applied={T|T < 7316275685125181440}]
I20260808 14:41:58.448205 15640 mvcc.cc:205] Tried to move back new op lower bound from 7316275685125181440 to 7316275684945256448. Current Snapshot: MvccSnapshot[applied={T|T < 7316275685125181440}]
I20260808 14:41:58.449999 15643 mvcc.cc:205] Tried to move back new op lower bound from 7316275685125181440 to 7316275684945256448. Current Snapshot: MvccSnapshot[applied={T|T < 7316275685125181440}]
I20260808 14:41:58.452913 14778 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:41:58.453006 14778 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:41:58.453794 14778 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e1e9e376bfa43b1b9787b9338188f00: Sending DeleteTablet for 3 replicas of tablet 54d7fa552d974010922de7ea8b30fc23
I20260808 14:41:58.454466 15487 tablet_service.cc:1514] Processing DeleteTablet for tablet 54d7fa552d974010922de7ea8b30fc23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:41:58 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:59070
I20260808 14:41:58.454521 15241 tablet_service.cc:1514] Processing DeleteTablet for tablet 54d7fa552d974010922de7ea8b30fc23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:41:58 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:43518
I20260808 14:41:58.454890 14981 tablet_service.cc:1514] Processing DeleteTablet for tablet 54d7fa552d974010922de7ea8b30fc23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:41:58 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:53976
I20260808 14:41:58.455526 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 14905
I20260808 14:41:58.471071 15653 tablet_replica.cc:330] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: stopping tablet replica
I20260808 14:41:58.471213 15653 raft_consensus.cc:2229] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:41:58.471344 15653 raft_consensus.cc:2258] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:41:58.471946 15653 ts_tablet_manager.cc:1905] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 14:41:58.479209 14756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:44103 (error 108)
I20260808 14:41:58.479802 15653 ts_tablet_manager.cc:1918] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:41:58.479918 15653 log.cc:1196] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/54d7fa552d974010922de7ea8b30fc23
I20260808 14:41:58.480217 15653 ts_tablet_manager.cc:1939] T 54d7fa552d974010922de7ea8b30fc23 P c492201c172042d1adea5f76da8b6691: Deleting consensus metadata
I20260808 14:41:58.480752 14751 catalog_manager.cc:4841] TS c492201c172042d1adea5f76da8b6691 (127.29.168.194:32975): tablet 54d7fa552d974010922de7ea8b30fc23 (table test-table [id=2fb9b56a833a4db99a335e90405dd798]) successfully deleted
I20260808 14:41:58.480971 15652 tablet_replica.cc:330] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: stopping tablet replica
I20260808 14:41:58.481105 15652 raft_consensus.cc:2229] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:41:58.481264 15652 raft_consensus.cc:2258] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:41:58.481631 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 15129
I20260808 14:41:58.483600 15652 ts_tablet_manager.cc:1905] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:41:58.485374 15652 ts_tablet_manager.cc:1918] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:41:58.485446 15652 log.cc:1196] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/54d7fa552d974010922de7ea8b30fc23
I20260808 14:41:58.486065 15652 ts_tablet_manager.cc:1939] T 54d7fa552d974010922de7ea8b30fc23 P 69ee40e5fa84450287df8b9bdcf9a84d: Deleting consensus metadata
I20260808 14:41:58.486768 14751 catalog_manager.cc:4841] TS 69ee40e5fa84450287df8b9bdcf9a84d (127.29.168.195:34939): tablet 54d7fa552d974010922de7ea8b30fc23 (table test-table [id=2fb9b56a833a4db99a335e90405dd798]) successfully deleted
I20260808 14:41:58.487548 15606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:41:58.487403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:44103 (local address 127.0.0.1:54002)
0808 14:41:58.487465 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:41:58.487510 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:44103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 14:41:58.487849 14756 catalog_manager.cc:4584] TS bc0c3c893e6a4c0b844d586a9d99793f (127.29.168.193:44103): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 54d7fa552d974010922de7ea8b30fc23: Network error: Client connection negotiation failed: client connection to 127.29.168.193:44103: connect: Connection refused (error 111)
I20260808 14:41:58.489975 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 15369
I20260808 14:41:58.501241 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 14720
I20260808 14:41:58.512984 30371 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:41:58.856848 30371 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:41:58.856947 30371 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:41:59.200953 30371 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:41:59.201 UTC [14015] LOG: received smart shutdown request
2026-08-08 14:41:59.204 UTC [14015] LOG: background worker "logical replication launcher" (PID 14038) exited with exit code 1
2026-08-08 14:41:59.205 UTC [14023] LOG: shutting down
2026-08-08 14:41:59.349 UTC [14015] LOG: database system is shut down
2026-08-08T14:41:59Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (44955 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:41:59 dist-test-slave-mjjr krb5kdc[15666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:41:59 dist-test-slave-mjjr krb5kdc[15666](info): set up 2 sockets
Aug 08 14:41:59 dist-test-slave-mjjr krb5kdc[15666](info): commencing operation
krb5kdc: starting...
W20260808 14:42:00.626590 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:42:00 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:42:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:42:00Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/rangeradmin_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/rangeradmin_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/rangerlookup_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/rangerlookup_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
I20260808 14:42:00.779024 30371 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskniu_ne/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/postgres -l logfile start
2026-08-08 14:42:02.934 UTC [15711] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:42:02.934 UTC [15711] LOG: listening on IPv4 address "127.29.168.212", port 42841
2026-08-08 14:42:02.937 UTC [15711] LOG: listening on Unix socket "/tmp/.s.PGSQL.42841"
2026-08-08 14:42:02.957 UTC [15714] LOG: database system was shut down at 2026-08-08 14:42:01 UTC
2026-08-08 14:42:02.961 UTC [15711] LOG: database system is ready to accept connections
I20260808 14:42:04.071197 30371 mini_postgres.cc:96] Postgres bound to 42841
2026-08-08 14:42:04.078 UTC [15727] FATAL: database "slave" does not exist
127.29.168.212:42841 - accepting connections
I20260808 14:42:04.078613 30371 mini_ranger.cc:161] Starting Ranger...
I20260808 14:42:04.093403 30371 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:42:04.464315 30371 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:42:04.464399 30371 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-admin
2026-08-08 14:42:04,733 [I] DB FLAVOR :POSTGRES
2026-08-08 14:42:04,733 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:42:04,733 [I] Checking connection..
2026-08-08 14:42:04,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:42:04,988 [I] Checking connection passed.
2026-08-08 14:42:04,988 [I] --------- Verifying version history table ---------
2026-08-08 14:42:04,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:42:05,236 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:42:05,236 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:42:05,481 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:42:05,481 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:42:05,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:42:05.700 UTC [15827] WARNING: there is no transaction in progress
2026-08-08 14:42:05,708 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:42:05,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:42:05,961 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:42:05,961 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:42:05,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:42:06,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:42:06,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-mjjr.c.gcp-upstream.internal','N') ;"
2026-08-08 14:42:06,671 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:42:06,922 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:42:06,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:42:07,149 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:42:07,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:42:07,399 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:42:07,633 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:42:07,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:42:08.506 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.522 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.537 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.551 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.565 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.581 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.640 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.646 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.658 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.668 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.677 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.689 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.698 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.704 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.710 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:08.716 UTC [15995] WARNING: there is no transaction in progress
2026-08-08 14:42:09,275 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:42:09,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:42:09,506 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:42:09,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:42:09,766 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:42:09,766 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:42:10,011 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:42:10,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:42:10,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:42:10,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-mjjr.c.gcp-upstream.internal';"
2026-08-08 14:42:10,739 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:42:10,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:42:10,990 [I] DB_PATCHES have already been applied
I20260808 14:42:10.996209 30371 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-admin:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskniu_ne/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:42:10.996284 30371 mini_ranger.cc:193] Using host: 127.29.168.212
I20260808 14:42:10.999743 30371 mini_ranger.cc:227] Ranger admin URL: http://127.29.168.212:52085
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:42:11 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:42:12.319636 30371 mini_ranger.cc:160] Time spent starting Ranger: real 8.241s user 0.000s sys 0.009s
Aug 08, 2026 2:42:30 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:42:30 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 2:42:30 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:42:30 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:42:31 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:42:32.321131 30371 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.168.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.168.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/rangerkms_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.168.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/rangerkms_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.168.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.168.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.168.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/HTTP_127.29.168.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:42:32 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200152, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:42:32.397776 30371 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:42:32.407075 30371 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:42:33.101869 30371 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:42:33.101958 30371 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms
I20260808 14:42:33.101979 30371 mini_ranger_kms.cc:227] Using postgres at 127.29.168.212:42841
2026-08-08 14:42:33,267 [I] DB FLAVOR :POSTGRES
2026-08-08 14:42:33,268 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:42:33,268 [I] Checking connection
2026-08-08 14:42:33,268 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:42:33,527 [I] connection success
2026-08-08 14:42:33,528 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:42:33,528 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:42:33,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:42:33,775 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:42:33,775 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:42:33,775 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:42:33,775 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.168.212:42841/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:42:34,030 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:42:34.456974 30371 mini_ranger_kms.cc:310] Created kms service
I20260808 14:42:34.621958 30371 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:42:34.663509 30371 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:42:34 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200152, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:35.034348 30371 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:42:35.034584 30371 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms:/tmp/dist-test-taskniu_ne/build/release/bin/postgresql.jar:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskniu_ne/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:42:35.034610 30371 mini_ranger_kms.cc:240] Using host: 127.29.168.212
I20260808 14:42:35.038656 30371 mini_ranger_kms.cc:276] Ranger KMS PID: 16262
I20260808 14:42:35.038743 30371 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.168.212:36207
Aug 08, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:42:37 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200157, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.168.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:37.643460 30371 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.246s user 0.000s sys 0.151s
I20260808 14:42:37.643560 30371 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:42:37.643608 30371 mini_ranger_kms.cc:401] 127.29.168.212:36207/kms/v1/keys
Aug 08 14:42:37 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200157, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.168.212@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
Aug 08 14:42:38 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200157, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.168.212@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
Aug 08 14:42:40 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:42:40.245790 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33477
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33477
--ranger_config_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:40.348532 16344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:40.348721 16344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:40.348740 16344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:40.349789 16344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:40.349828 16344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:40.349840 16344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:40.349852 16344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:40.349897 16344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:40.351425 16344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.168.212:36207/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33477
--ranger_config_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:40.351679 16344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:40.351891 16344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:40.356383 16355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:40.356392 16351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:40.356436 16357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:40.356984 16344 server_base.cc:1034] running on GCE node
I20260808 14:42:40.357275 16344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:40.357615 16344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:40.358770 16344 hybrid_clock.cc:648] HybridClock initialized: now 1786200160358759 us; error 28 us; skew 500 ppm
Aug 08 14:42:40 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200160, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:40.365633 16344 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:40.366101 16344 webserver.cc:460] Webserver started at http://127.29.168.254:44091/ using document root <none> and password file <none>
I20260808 14:42:40.366313 16344 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:40.366350 16344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:40.366483 16344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:42:40 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200160, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:40.410853 16344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "fc57606876d442faa714931773bb6656"
format_stamp: "Formatted at 2026-08-08 14:42:40 on dist-test-slave-mjjr"
server_key: "2b80521a19f0b41c4f6c5b9c8ae83824"
server_key_iv: "8223c4f7a7265065790851de9fb5bf97"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:40.411273 16344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "fc57606876d442faa714931773bb6656"
format_stamp: "Formatted at 2026-08-08 14:42:40 on dist-test-slave-mjjr"
server_key: "2b80521a19f0b41c4f6c5b9c8ae83824"
server_key_iv: "8223c4f7a7265065790851de9fb5bf97"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:40.412757 16344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 14:42:40.423323 16368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:40.423530 16344 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:42:40.423647 16344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "fc57606876d442faa714931773bb6656"
format_stamp: "Formatted at 2026-08-08 14:42:40 on dist-test-slave-mjjr"
server_key: "2b80521a19f0b41c4f6c5b9c8ae83824"
server_key_iv: "8223c4f7a7265065790851de9fb5bf97"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:40.423744 16344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:40.438057 16344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:40.439978 16344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:40.440119 16344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:40.444949 16344 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33477
I20260808 14:42:40.444972 16440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33477 every 8 connection(s)
I20260808 14:42:40.445319 16344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:40.446178 16442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:40.449520 16442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Bootstrap starting.
I20260808 14:42:40.450222 16442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:40.450531 16442 log.cc:824] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:40.451210 16442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: No bootstrap required, opened a new log
I20260808 14:42:40.451812 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 16344
I20260808 14:42:40.451910 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:42:40.452075 30371 external_mini_cluster.cc:1428] Setting key 01aa783033da9e36654671b6a0c2120e
I20260808 14:42:40.453678 16442 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:40.453882 16442 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:40.453949 16442 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc57606876d442faa714931773bb6656, State: Initialized, Role: FOLLOWER
I20260808 14:42:40.454097 16442 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:40.454169 16442 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:42:40.454197 16442 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:42:40.454255 16442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:40.454952 16442 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:40.455056 16442 leader_election.cc:302] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc57606876d442faa714931773bb6656; no voters:
I20260808 14:42:40.455237 16442 leader_election.cc:288] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:42:40.455289 16449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:42:40.455499 16449 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 LEADER]: Becoming Leader. State: Replica: fc57606876d442faa714931773bb6656, State: Running, Role: LEADER
I20260808 14:42:40.455541 16442 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:40.457399 16449 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:40.458027 16450 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc57606876d442faa714931773bb6656" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } } }
I20260808 14:42:40.458097 16450 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:40.458123 16451 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc57606876d442faa714931773bb6656. Latest consensus state: current_term: 1 leader_uuid: "fc57606876d442faa714931773bb6656" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } } }
I20260808 14:42:40.458194 16451 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:40.458591 16442 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 14:42:40 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:40.463872 16471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:40.464480 16471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:40.466197 16448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:40.452532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42794 (local address 127.29.168.254:33477)
0808 14:42:40.452691 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:40.452699 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:40.452761 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:42:40.453656 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:40.453663 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:40.453708 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:40.453848 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:40.454600 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:40.455793 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:40.457308 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:40.457861 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:40.457965 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:40.461028 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:40.461082 (+ 54us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:40.461082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:40.461200 (+ 118us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:40.463933 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:40.464351 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:40.464354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:40.464354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:40.464468 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:40.464668 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:40.464669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:40.464669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:40.465039 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:40.465206 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:40.465757 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 14:42:40.465926 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260808 14:42:40.471752 16471 catalog_manager.cc:1347] Generated new cluster ID: aa641f54781f479ea084151f1443a4f2
I20260808 14:42:40.471849 16471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:42:40.479727 16471 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:42:40.480516 16471 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:42:40.488065 16471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Generated new TSK 0
I20260808 14:42:40.488291 16471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:42:41.189815 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33477
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:41.275375 16511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:41.275581 16511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:41.275616 16511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:41.276795 16511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:41.276847 16511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:41.276880 16511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:42:41.278303 16511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.168.212:36207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:41.278558 16511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:41.278772 16511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:41.284546 16520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:41.284574 16522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:41.284772 16518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:41.284973 16511 server_base.cc:1034] running on GCE node
I20260808 14:42:41.285176 16511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:41.285406 16511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:41.286607 16511 hybrid_clock.cc:648] HybridClock initialized: now 1786200161286591 us; error 31 us; skew 500 ppm
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:41.289305 16511 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:42:41.289713 16511 webserver.cc:460] Webserver started at http://127.29.168.193:35157/ using document root <none> and password file <none>
I20260808 14:42:41.289948 16511 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:41.290045 16511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:41.290174 16511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:41.303972 16511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "7859275ba93645c48f6b43cae48f13dd"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "f87319438d7c2ab033f088662471395e"
server_key_iv: "c9dbfa5dfde16ee30bc22077016d0de8"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.304394 16511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "7859275ba93645c48f6b43cae48f13dd"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "f87319438d7c2ab033f088662471395e"
server_key_iv: "c9dbfa5dfde16ee30bc22077016d0de8"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.306454 16511 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:42:41.326733 16535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.326985 16511 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260808 14:42:41.327102 16511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "7859275ba93645c48f6b43cae48f13dd"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "f87319438d7c2ab033f088662471395e"
server_key_iv: "c9dbfa5dfde16ee30bc22077016d0de8"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.327191 16511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:41.344869 16511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:41.347215 16511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:41.347445 16511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:41.347781 16511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:41.348202 16511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:41.348289 16511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.348407 16511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:41.348487 16511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.355180 16511 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:36595
I20260808 14:42:41.355691 16511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:42:41.365013 16701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:36595 every 8 connection(s)
I20260808 14:42:41.365732 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 16511
I20260808 14:42:41.365835 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:42:41.366040 30371 external_mini_cluster.cc:1428] Setting key d2593369a756009a19daa24c0e5b1374
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:41.375037 16708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:41.366010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:50893 (local address 127.29.168.254:33477)
0808 14:42:41.366169 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:41.366172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:41.366320 (+ 148us) server_negotiation.cc:407] Connection header received
0808 14:42:41.366994 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:41.366995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:41.367009 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:41.367081 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:41.367802 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.368368 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.369700 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.370008 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.370099 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:41.372222 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:41.372224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:41.372225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:41.372231 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:41.373653 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:41.374063 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:41.374064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:41.374065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:41.374127 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:41.374389 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:41.374390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:41.374390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:41.374502 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:41.374572 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:41.374872 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 14:42:41.374951 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":100,"threads_started":1}
I20260808 14:42:41.375205 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:41.365718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33477 (local address 127.29.168.193:50893)
0808 14:42:41.366189 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:41.366234 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:41.366884 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:41.367148 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:41.367152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:41.367388 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:41.367685 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:41.367691 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.368464 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.368464 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:41.369598 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:41.369601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.370125 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.370125 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:41.370214 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:41.370763 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:41.370779 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:41.372116 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:41.373743 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:41.373750 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:41.373752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:41.373983 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:41.374200 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:41.374201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:41.374201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:41.374313 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:41.374575 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:41.374583 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:41.374715 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 14:42:41.374849 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 14:42:41.374980 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":79,"threads_started":1}
I20260808 14:42:41.375933 16702 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33477
I20260808 14:42:41.376036 16702 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:41.376202 16702 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
I20260808 14:42:41.376729 16396 ts_manager.cc:194] Registered new tserver with Master: 7859275ba93645c48f6b43cae48f13dd (127.29.168.193:36595)
I20260808 14:42:41.377429 16396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:50893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:42:41.402320 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33477
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:42:41.538983 16713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:41.539235 16713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:41.539266 16713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:41.540890 16713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:41.540943 16713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:41.540979 16713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:42:41.543277 16713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.168.212:36207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:41.543520 16713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:41.543851 16713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:41.551343 16722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:41.551906 16723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:41.552098 16728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:41.553277 16713 server_base.cc:1034] running on GCE node
I20260808 14:42:41.553552 16713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:41.553902 16713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:41.556768 16713 hybrid_clock.cc:648] HybridClock initialized: now 1786200161556683 us; error 58 us; skew 500 ppm
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:41.562263 16713 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:42:41.562791 16713 webserver.cc:460] Webserver started at http://127.29.168.194:42355/ using document root <none> and password file <none>
I20260808 14:42:41.563068 16713 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:41.563148 16713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:41.563298 16713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:41.578960 16713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "f0e10648be354a59b3da432dde7063c9"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "7fb5011341fea0eea9224753ab8f42af"
server_key_iv: "7bec44167fb5281b25ee6be97a93bf91"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.583969 16713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "f0e10648be354a59b3da432dde7063c9"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "7fb5011341fea0eea9224753ab8f42af"
server_key_iv: "7bec44167fb5281b25ee6be97a93bf91"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.593982 16713 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.001s sys 0.001s
I20260808 14:42:41.612849 16739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.613196 16713 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:41.613332 16713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "f0e10648be354a59b3da432dde7063c9"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "7fb5011341fea0eea9224753ab8f42af"
server_key_iv: "7bec44167fb5281b25ee6be97a93bf91"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.613430 16713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:41.638736 16713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:41.641481 16713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:41.641691 16713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:41.642148 16713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:41.642669 16713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:41.642788 16713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.642865 16713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:41.642930 16713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.657619 16713 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:41889
I20260808 14:42:41.657716 16897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:41889 every 8 connection(s)
I20260808 14:42:41.658439 16713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:42:41.662231 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 16713
I20260808 14:42:41.662340 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:42:41.662562 30371 external_mini_cluster.cc:1428] Setting key 559f2b396bd48ac483086d7981a56885
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:41.671406 16708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:41.659768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:54923 (local address 127.29.168.254:33477)
0808 14:42:41.659830 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:41.659832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:41.659851 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:42:41.660572 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:41.660573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:41.660591 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:41.660640 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:41.661429 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.662223 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.664694 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.665104 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.665158 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:41.668074 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:41.668076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:41.668076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:41.668084 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:41.669753 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:41.670229 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:41.670230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:41.670230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:41.670299 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:41.670591 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:41.670592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:41.670592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:41.670741 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:41.670793 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:41.671161 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 14:42:41.671254 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:42:41.672187 16903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:41.659433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33477 (local address 127.29.168.194:54923)
0808 14:42:41.659705 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:41.659751 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:41.660447 (+ 696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:41.660780 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:41.660784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:41.661034 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:41.661310 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:41.661317 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.662445 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.662446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:41.664585 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:41.664588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.665302 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.665303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:41.665476 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:41.666171 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:41.666182 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:41.667984 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:41.669839 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:41.669862 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:41.669864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:41.670144 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:41.670367 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:41.670368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:41.670368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:41.670511 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:41.670825 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:41.670832 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:41.671005 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 14:42:41.671767 (+ 762us) client_negotiation.cc:240] Negotiation successful
0808 14:42:41.671935 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":110,"threads_started":1}
I20260808 14:42:41.672873 16898 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33477
I20260808 14:42:41.672992 16898 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:41.673177 16898 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:41.673568 16396 ts_manager.cc:194] Registered new tserver with Master: f0e10648be354a59b3da432dde7063c9 (127.29.168.194:41889)
I20260808 14:42:41.674011 16396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:54923
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:42:41.714644 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33477
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:41.874377 16910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:41.874660 16910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:41.874697 16910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:41.876502 16910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:41.876662 16910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:41.876729 16910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:42:41.879357 16910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.168.212:36207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:33477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:41.879782 16910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:41.880139 16910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:41.887795 16917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:41.887794 16915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:41.888681 16920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:41.888929 16910 server_base.cc:1034] running on GCE node
I20260808 14:42:41.889113 16910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:41.889364 16910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:41.890547 16910 hybrid_clock.cc:648] HybridClock initialized: now 1786200161890523 us; error 36 us; skew 500 ppm
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:41.894646 16910 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:42:41.895187 16910 webserver.cc:460] Webserver started at http://127.29.168.195:43143/ using document root <none> and password file <none>
I20260808 14:42:41.895639 16910 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:41.895793 16910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:41.895977 16910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:41.913117 16910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "31fd4ae8eb4f4f49afe0f31f091dd984"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "b02d09fbc121ebf7ae84a9c54eacb22b"
server_key_iv: "b824ec4d50800489628d6c8971a3310b"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.913601 16910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "31fd4ae8eb4f4f49afe0f31f091dd984"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "b02d09fbc121ebf7ae84a9c54eacb22b"
server_key_iv: "b824ec4d50800489628d6c8971a3310b"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.915366 16910 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:42:41.934657 16928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.934973 16910 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:42:41.935104 16910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "31fd4ae8eb4f4f49afe0f31f091dd984"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "b02d09fbc121ebf7ae84a9c54eacb22b"
server_key_iv: "b824ec4d50800489628d6c8971a3310b"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:41.935235 16910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:41.959299 16910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:41.961607 16910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:41.961794 16910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:41.962031 16910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:41.962455 16910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:41.962509 16910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.962551 16910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:41.962577 16910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:41.980185 16910 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:41869
I20260808 14:42:41.980345 17098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:41869 every 8 connection(s)
I20260808 14:42:41.980695 16910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:42:41.984403 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 16910
I20260808 14:42:41.984535 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:42:41.984761 30371 external_mini_cluster.cc:1428] Setting key 9a0723d1eb0bc1dd84ae83ef64869801
Aug 08 14:42:41 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200161, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:41.996424 16708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:41.981864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:45625 (local address 127.29.168.254:33477)
0808 14:42:41.981953 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:41.981955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:41.982445 (+ 490us) server_negotiation.cc:407] Connection header received
0808 14:42:41.983859 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:41.983860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:41.983873 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:41.983925 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:41.985638 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.986131 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.988911 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.989085 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.989149 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:41.992531 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:41.992533 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:41.992533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:41.992541 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:41.994738 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:41.995243 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:41.995244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:41.995245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:41.995304 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:41.995604 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:41.995605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:41.995606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:41.995769 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:41.995838 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:41.996227 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 14:42:41.996339 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:42:41.997674 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:41.981815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33477 (local address 127.29.168.195:45625)
0808 14:42:41.982201 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:41.982282 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:41.983687 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:41.984073 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:41.984084 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:41.984732 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:41.985520 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:41.985534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.986243 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.986244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:41.988680 (+ 2436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:41.988719 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:41.989251 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:41.989252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:41.989519 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:41.990371 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:41.990388 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:41.992418 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:41.994853 (+ 2435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:41.994860 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:41.994862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:41.995148 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:41.995378 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:41.995379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:41.995379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:41.995511 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:41.995875 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:41.995882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:41.996034 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 14:42:41.996147 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:42:41.996289 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":231,"threads_started":1}
I20260808 14:42:41.998358 17099 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33477
I20260808 14:42:41.998498 17099 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:41.998747 17099 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:41.999133 16396 ts_manager.cc:194] Registered new tserver with Master: 31fd4ae8eb4f4f49afe0f31f091dd984 (127.29.168.195:41869)
I20260808 14:42:41.999544 16396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:45625
I20260808 14:42:42.008460 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:42:42.009161 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 16511
I20260808 14:42:42.017784 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 16713
I20260808 14:42:42.029500 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 16910
I20260808 14:42:42.040098 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 16344
I20260808 14:42:42.055519 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33477
--webserver_interface=127.29.168.254
--webserver_port=44091
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33477
--ranger_config_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:42.134220 17102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:42.134408 17102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:42.134430 17102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:42.135514 17102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:42.135558 17102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:42.135572 17102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:42.135584 17102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:42.135596 17102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:42.137041 17102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33477
--ranger_config_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=44091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:42.137215 17102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:42.137372 17102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:42.141809 17117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.141824 17113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.141904 17115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:42.142014 17102 server_base.cc:1034] running on GCE node
I20260808 14:42:42.142331 17102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:42.142588 17102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:42.143725 17102 hybrid_clock.cc:648] HybridClock initialized: now 1786200162143706 us; error 30 us; skew 500 ppm
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:42.146098 17102 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:42.146528 17102 webserver.cc:460] Webserver started at http://127.29.168.254:44091/ using document root <none> and password file <none>
I20260808 14:42:42.146764 17102 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:42.146842 17102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:42.191092 17102 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:42.192005 17132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.192215 17102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:42.192322 17102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "fc57606876d442faa714931773bb6656"
format_stamp: "Formatted at 2026-08-08 14:42:40 on dist-test-slave-mjjr"
server_key: "2b80521a19f0b41c4f6c5b9c8ae83824"
server_key_iv: "8223c4f7a7265065790851de9fb5bf97"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:42.192716 17102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:42.203084 17102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:42.205112 17102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:42.205216 17102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:42.209122 17102 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33477
I20260808 14:42:42.209216 17215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33477 every 8 connection(s)
I20260808 14:42:42.209523 17102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:42.210623 17217 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:42:42.210909 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 17102
I20260808 14:42:42.211198 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:36595
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:33477
--webserver_port=35157
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:42.211532 17217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Bootstrap starting.
I20260808 14:42:42.220037 17217 log.cc:824] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:42.221725 17217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:42:42.221997 17217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Bootstrap complete.
I20260808 14:42:42.224428 17217 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:42.224640 17217 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc57606876d442faa714931773bb6656, State: Initialized, Role: FOLLOWER
I20260808 14:42:42.224821 17217 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:42.224892 17217 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:42:42.224969 17217 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:42:42.225011 17217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:42:42.225935 17217 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:42.226040 17217 leader_election.cc:302] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc57606876d442faa714931773bb6656; no voters:
I20260808 14:42:42.226243 17217 leader_election.cc:288] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:42:42.226279 17222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:42:42.226449 17222 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [term 2 LEADER]: Becoming Leader. State: Replica: fc57606876d442faa714931773bb6656, State: Running, Role: LEADER
I20260808 14:42:42.226524 17217 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:42.227218 17222 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } }
I20260808 14:42:42.227797 17224 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fc57606876d442faa714931773bb6656" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } } }
I20260808 14:42:42.227891 17224 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:42.228063 17223 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc57606876d442faa714931773bb6656. Latest consensus state: current_term: 2 leader_uuid: "fc57606876d442faa714931773bb6656" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc57606876d442faa714931773bb6656" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33477 } } }
I20260808 14:42:42.228111 17223 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656 [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:42.228165 17217 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:42:42.228204 17242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:42.231213 17242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:42.231629 17242 catalog_manager.cc:1259] Loaded cluster ID: aa641f54781f479ea084151f1443a4f2
I20260808 14:42:42.231693 17242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:42:42.233520 17242 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:42:42.233695 17242 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Loaded TSK: 0
I20260808 14:42:42.233930 17242 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:42:42.321547 17219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:42.321920 17219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:42.322028 17219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:42.323752 17219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:42.323810 17219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:42.323858 17219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:42:42.326028 17219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:36595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=35157
--tserver_master_addrs=127.29.168.254:33477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:42.326404 17219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:42.326733 17219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:42.333021 17268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.333374 17272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.334394 17269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:42.334626 17219 server_base.cc:1034] running on GCE node
I20260808 14:42:42.334944 17219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:42.335234 17219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:42.336405 17219 hybrid_clock.cc:648] HybridClock initialized: now 1786200162336384 us; error 36 us; skew 500 ppm
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:42.339674 17219 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:42:42.340281 17219 webserver.cc:460] Webserver started at http://127.29.168.193:35157/ using document root <none> and password file <none>
I20260808 14:42:42.340611 17219 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:42.340775 17219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:42.368868 17219 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260808 14:42:42.369581 17281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.369762 17219 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.369831 17219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "7859275ba93645c48f6b43cae48f13dd"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "f87319438d7c2ab033f088662471395e"
server_key_iv: "c9dbfa5dfde16ee30bc22077016d0de8"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:42.370857 17219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:42.399484 17219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:42.405589 17219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:42.405786 17219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:42.406059 17219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:42.406502 17219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:42.406620 17219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.406724 17219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:42.406764 17219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.414279 17219 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:36595
I20260808 14:42:42.414839 17219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:42:42.418936 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 17219
I20260808 14:42:42.419270 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:41889
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:33477
--webserver_port=42355
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:42.416738 17454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:36595 every 8 connection(s)
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:42.437148 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.417338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33477 (local address 127.29.168.193:44005)
0808 14:42:42.417997 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:42.418040 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:42.418664 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:42.419371 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:42.419376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:42.419607 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:42.420096 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:42.420103 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.428368 (+ 8265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.428369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:42.429623 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:42.429626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.430559 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.430561 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:42.430688 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.431284 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:42.431294 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:42.432986 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:42.435272 (+ 2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:42.435278 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:42.435280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:42.435601 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:42.435902 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:42.435903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:42.435903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:42.436031 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:42.436489 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:42.436494 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:42.436625 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 14:42:42.436717 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:42:42.436891 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":88,"threads_started":1}
I20260808 14:42:42.437966 17459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.417692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:44005 (local address 127.29.168.254:33477)
0808 14:42:42.418881 (+ 1189us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:42.418891 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:42.418926 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:42:42.419085 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:42.419090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:42.419146 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:42.419295 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:42.420246 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.428229 (+ 7983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.429735 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.430351 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.430450 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.433109 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:42.433113 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:42.433114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:42.433125 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:42.435163 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.435711 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.435714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.435714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.435813 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.436108 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.436109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.436109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.436382 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:42.436460 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:42.437643 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0808 14:42:42.437762 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1134,"thread_start_us":78,"threads_started":1}
I20260808 14:42:42.438840 17455 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33477
I20260808 14:42:42.438930 17455 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.439109 17455 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
W20260808 14:42:42.440011 17455 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:33477 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:42:42.440075 17455 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.440132 17455 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:42.440508 17455 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.440577 17455 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
W20260808 14:42:42.440903 17455 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:42:42.524513 17460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:42.524763 17460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:42.524797 17460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:42.526352 17460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:42.526401 17460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:42.526436 17460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:42:42.528587 17460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:41889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=42355
--tserver_master_addrs=127.29.168.254:33477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:42.528950 17460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:42.529219 17460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:42.535498 17473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.535482 17471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.535562 17470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:42.535779 17460 server_base.cc:1034] running on GCE node
I20260808 14:42:42.536113 17460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:42.536350 17460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:42.537541 17460 hybrid_clock.cc:648] HybridClock initialized: now 1786200162537527 us; error 34 us; skew 500 ppm
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:42.540289 17460 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:42:42.540820 17460 webserver.cc:460] Webserver started at http://127.29.168.194:42355/ using document root <none> and password file <none>
I20260808 14:42:42.541055 17460 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:42.541134 17460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:42.567217 17460 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:42.568432 17492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.568629 17460 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:42.568711 17460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "f0e10648be354a59b3da432dde7063c9"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "7fb5011341fea0eea9224753ab8f42af"
server_key_iv: "7bec44167fb5281b25ee6be97a93bf91"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:42.569151 17460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:42.584422 17460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:42.586689 17460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:42.586843 17460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:42.587064 17460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:42.587438 17460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:42.587481 17460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.587509 17460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:42.587527 17460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.594554 17460 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:41889
I20260808 14:42:42.595012 17460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:42:42.596084 17662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:41889 every 8 connection(s)
I20260808 14:42:42.596740 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 17460
I20260808 14:42:42.597038 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.168.212:36207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:41869
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:33477
--webserver_port=43143
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:42.617584 17459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.597063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:40887 (local address 127.29.168.254:33477)
0808 14:42:42.597118 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:42.597120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:42.607903 (+ 10783us) server_negotiation.cc:407] Connection header received
0808 14:42:42.608432 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:42.608434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:42.608448 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:42.608502 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:42.609294 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.610078 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.611563 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.611923 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.611969 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.614369 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:42.614370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:42.614371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:42.614377 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:42.616085 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.616545 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.616546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.616547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.616599 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.616856 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.616857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.616857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.616985 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:42.617029 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:42.617406 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 14:42:42.617486 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:42:42.618320 17665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.597080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33477 (local address 127.29.168.194:40887)
0808 14:42:42.607765 (+ 10685us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:42.607804 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:42.608323 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:42.608646 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:42.608651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:42.608901 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:42.609168 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:42.609174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.610201 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.610202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:42.611457 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:42.611460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.612092 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.612093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:42.612227 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.612833 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:42.612843 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:42.614259 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:42.616179 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:42.616185 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:42.616188 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:42.616458 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:42.616664 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:42.616665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:42.616665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:42.616788 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:42.617078 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:42.617085 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:42.617250 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 14:42:42.617939 (+ 689us) client_negotiation.cc:240] Negotiation successful
0808 14:42:42.618096 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10639,"thread_start_us":84,"threads_started":1}
I20260808 14:42:42.618976 17663 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33477
I20260808 14:42:42.619065 17663 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.619232 17663 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
W20260808 14:42:42.619801 17663 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:33477 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:42:42.619858 17663 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.619911 17663 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:42.620246 17663 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.620316 17663 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
W20260808 14:42:42.620649 17663 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:42:42.722215 17666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:42.722608 17666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:42.722642 17666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:42.724326 17666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:42.724387 17666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:42.724426 17666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:42:42.726640 17666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.168.212:36207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:41869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=43143
--tserver_master_addrs=127.29.168.254:33477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:42.726864 17666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:42.727144 17666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:42.733327 17677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.733598 17673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:42.733880 17674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:42.734803 17666 server_base.cc:1034] running on GCE node
I20260808 14:42:42.735036 17666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:42.735280 17666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:42.742619 17666 hybrid_clock.cc:648] HybridClock initialized: now 1786200162742592 us; error 39 us; skew 500 ppm
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:42.745700 17666 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:42:42.746201 17666 webserver.cc:460] Webserver started at http://127.29.168.195:43143/ using document root <none> and password file <none>
I20260808 14:42:42.746444 17666 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:42.746529 17666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:42.762995 17666 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 14:42:42.763662 17690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.763840 17666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:42.763924 17666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "31fd4ae8eb4f4f49afe0f31f091dd984"
format_stamp: "Formatted at 2026-08-08 14:42:41 on dist-test-slave-mjjr"
server_key: "b02d09fbc121ebf7ae84a9c54eacb22b"
server_key_iv: "b824ec4d50800489628d6c8971a3310b"
server_key_version: "kuduclusterkey@0"
I20260808 14:42:42.764277 17666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:42.781740 17666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:42.783860 17666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:42.784026 17666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:42.784282 17666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:42.784655 17666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:42.784713 17666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.784744 17666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:42.784762 17666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:42.792641 17666 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:41869
I20260808 14:42:42.793107 17666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:42:42.793426 17867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:41869 every 8 connection(s)
I20260808 14:42:42.796200 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 17666
Aug 08 14:42:42 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200162, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:42.805269 17871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.793811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:33477 (local address 127.29.168.195:50487)
0808 14:42:42.793991 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:42.794031 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:42.794533 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:42.794827 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:42.794830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:42.795000 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:42.795174 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:42.795178 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.796562 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.796563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:42.797527 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:42.797529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.798082 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.798083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:42.798225 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.799803 (+ 1578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:42.799813 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:42.801454 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:42.803606 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:42.803613 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:42.803615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:42.803903 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:42.804128 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:42.804129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:42.804129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:42.804261 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:42.804574 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:42.804580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:42.804740 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 14:42:42.804857 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 14:42:42.805018 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
I20260808 14:42:42.805904 17459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.793840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:50487 (local address 127.29.168.254:33477)
0808 14:42:42.793921 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:42.793923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:42.794139 (+ 216us) server_negotiation.cc:407] Connection header received
0808 14:42:42.794665 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:42.794667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:42.794681 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:42.794774 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:42.795305 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.796069 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.797612 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.797935 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.798035 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.801576 (+ 3541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:42.801577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:42.801578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:42.801586 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:42.803511 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.803985 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.803987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.803987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.804051 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.804325 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.804327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.804327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.804468 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:42.804540 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:42.805775 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0808 14:42:42.805844 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":48}
I20260808 14:42:42.806257 17869 heartbeater.cc:347] Connected to a master server at 127.29.168.254:33477
I20260808 14:42:42.806344 17869 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.806494 17869 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
W20260808 14:42:42.807145 17869 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:33477 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:42:42.807225 17869 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.807305 17869 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:42.807595 17869 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:42.807700 17869 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
W20260808 14:42:42.807978 17869 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:42:42.815889 17872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:42.796608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.29.168.254:33477)
0808 14:42:42.797629 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:42.797630 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:42.797636 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:42:42.797655 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:42.797655 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:42.797665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:42.797752 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:42.800503 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.802537 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.803732 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:42.804059 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:42.804136 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:42.813091 (+ 8955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:42.813092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:42.813093 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:42.813098 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:42.814745 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.815109 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.815111 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.815111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.815171 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:42.815369 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:42.815370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:42.815370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:42.815473 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:42.815670 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:42.815706 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:42:42.815784 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1005,"thread_start_us":56,"threads_started":1}
Aug 08 14:42:43 dist-test-slave-mjjr krb5kdc[15666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200163, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:43.441102 17455 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:43.441282 17455 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:43.441745 17161 ts_manager.cc:194] Registered new tserver with Master: 7859275ba93645c48f6b43cae48f13dd (127.29.168.193:36595)
I20260808 14:42:43.442690 17161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:44005
I20260808 14:42:43.620832 17663 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:43.620982 17663 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:43.621336 17161 ts_manager.cc:194] Registered new tserver with Master: f0e10648be354a59b3da432dde7063c9 (127.29.168.194:41889)
I20260808 14:42:43.621974 17161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:40887
I20260808 14:42:43.808178 17869 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:43.808336 17869 heartbeater.cc:511] Master 127.29.168.254:33477 requested a full tablet report, sending...
I20260808 14:42:43.808619 17161 ts_manager.cc:194] Registered new tserver with Master: 31fd4ae8eb4f4f49afe0f31f091dd984 (127.29.168.195:41869)
I20260808 14:42:43.809139 17161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:50487
I20260808 14:42:43.818192 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:42:43.828047 17895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.819240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.29.168.254:33477)
0808 14:42:43.819529 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:43.819531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:43.819685 (+ 154us) server_negotiation.cc:407] Connection header received
0808 14:42:43.819777 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:43.819778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:43.819790 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:43.819841 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:43.820668 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.821416 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.822445 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.822751 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.822826 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.824621 (+ 1795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:43.824623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:43.824623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:43.824630 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:43.826621 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:43.827010 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:43.827012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:43.827012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:43.827078 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:43.827333 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:43.827334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:43.827334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:43.827446 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:43.827554 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:43.827753 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:42:43.827841 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":75,"threads_started":1}
I20260808 14:42:43.835911 17161 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42812:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:42:43.838029 17161 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:42:43.847060 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.841721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53168 (local address 127.29.168.193:36595)
0808 14:42:43.841965 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:43.841970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:43.842224 (+ 254us) server_negotiation.cc:407] Connection header received
0808 14:42:43.842331 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:43.842333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:43.842347 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:43.842417 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:43.842888 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.844026 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.845657 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.846504 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.846559 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.846618 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:43.846901 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 14:42:43.846947 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":73,"threads_started":1}
I20260808 14:42:43.847116 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.841300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:41889 (local address 127.0.0.1:36600)
0808 14:42:43.841512 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:43.841550 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:43.841604 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:43.842712 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:43.842712 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:43.842714 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:43.842760 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:43.842761 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.844504 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.844504 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:43.845531 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:43.845533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.846870 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.846871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:43.846939 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.846942 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:42:43.846971 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 14:42:43.847021 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260808 14:42:43.847263 17908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.841602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:36595 (local address 127.0.0.1:53168)
0808 14:42:43.842148 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:43.842159 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:43.842250 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:43.842621 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:43.842625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:43.842627 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:43.842694 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:43.842695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.844132 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.844133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:43.845531 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:43.845533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.846680 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.846681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:43.846774 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.846791 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 14:42:43.847148 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 14:42:43.847187 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":734,"threads_started":1}
I20260808 14:42:43.848107 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.841753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36600 (local address 127.29.168.194:41889)
0808 14:42:43.842548 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:43.842552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:43.842561 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:42:43.842594 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:43.842596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:43.842621 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:43.842968 (+ 347us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:43.843048 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.844088 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.845653 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.846780 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.847914 (+ 1134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.847973 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:43.847998 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 14:42:43.848037 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":86,"threads_started":1}
I20260808 14:42:43.848277 17361 tablet_service.cc:1467] Processing CreateTablet for tablet c13de7952c3a4131ac6ef8b050aa1936 (DEFAULT_TABLE table=test-table [id=736b9038e3fb485c94616b71002c43d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:43.848688 17361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13de7952c3a4131ac6ef8b050aa1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:43.848884 17535 tablet_service.cc:1467] Processing CreateTablet for tablet c13de7952c3a4131ac6ef8b050aa1936 (DEFAULT_TABLE table=test-table [id=736b9038e3fb485c94616b71002c43d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:43.849196 17535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13de7952c3a4131ac6ef8b050aa1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:43.853684 17913 tablet_bootstrap.cc:492] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: Bootstrap starting.
Aug 08 14:42:43 dist-test-slave-mjjr krb5kdc[15666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200163, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for HTTP/127.29.168.212@KRBTEST.COM
I20260808 14:42:43.854660 17913 tablet_bootstrap.cc:654] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:43.855270 17913 log.cc:824] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:43.855684 17914 tablet_bootstrap.cc:492] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Bootstrap starting.
I20260808 14:42:43.856738 17914 tablet_bootstrap.cc:654] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:43.857255 17914 log.cc:824] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:43.857903 17913 tablet_bootstrap.cc:492] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: No bootstrap required, opened a new log
I20260808 14:42:43.857982 17913 ts_tablet_manager.cc:1397] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:42:43.858724 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.841979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:41869 (local address 127.0.0.1:57168)
0808 14:42:43.847175 (+ 5196us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:43.847184 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:43.847223 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:43.854835 (+ 7612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:43.854837 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:43.854839 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:43.854879 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:43.854880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.856279 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.856281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:43.857339 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:43.857343 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.858461 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.858462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:43.858556 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.858560 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:42:43.858593 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 14:42:43.858645 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5186,"thread_start_us":68,"threads_started":1}
I20260808 14:42:43.859351 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:43.842256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57168 (local address 127.29.168.195:41869)
0808 14:42:43.854610 (+ 12354us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:43.854615 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:43.854628 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:42:43.854666 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:43.854668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:43.854686 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:43.854987 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:43.855149 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.856157 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.857460 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:43.858350 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:43.859078 (+ 728us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:43.859139 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:43.859166 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 14:42:43.859202 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12308,"thread_start_us":51,"threads_started":1}
I20260808 14:42:43.859706 17914 tablet_bootstrap.cc:492] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: No bootstrap required, opened a new log
I20260808 14:42:43.859819 17914 ts_tablet_manager.cc:1397] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:42:43.860235 17768 tablet_service.cc:1467] Processing CreateTablet for tablet c13de7952c3a4131ac6ef8b050aa1936 (DEFAULT_TABLE table=test-table [id=736b9038e3fb485c94616b71002c43d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:43.860626 17768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13de7952c3a4131ac6ef8b050aa1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:43.863523 17914 raft_consensus.cc:348] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:43.863693 17914 raft_consensus.cc:374] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:43.863731 17914 raft_consensus.cc:729] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e10648be354a59b3da432dde7063c9, State: Initialized, Role: FOLLOWER
I20260808 14:42:43.863906 17914 consensus_queue.cc:260] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:43.864202 17914 ts_tablet_manager.cc:1428] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Time spent starting tablet: real 0.004s user 0.003s sys 0.002s
I20260808 14:42:43.867079 17913 raft_consensus.cc:348] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:43.867259 17913 raft_consensus.cc:374] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:43.867295 17913 raft_consensus.cc:729] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7859275ba93645c48f6b43cae48f13dd, State: Initialized, Role: FOLLOWER
I20260808 14:42:43.867416 17913 consensus_queue.cc:260] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:43.867726 17663 heartbeater.cc:503] Master 127.29.168.254:33477 was elected leader, sending a full tablet report...
I20260808 14:42:43.868038 17455 heartbeater.cc:503] Master 127.29.168.254:33477 was elected leader, sending a full tablet report...
I20260808 14:42:43.868134 17913 ts_tablet_manager.cc:1428] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20260808 14:42:43.871479 17920 tablet_bootstrap.cc:492] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Bootstrap starting.
I20260808 14:42:43.872536 17920 tablet_bootstrap.cc:654] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:43.873065 17920 log.cc:824] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:43.873867 17920 tablet_bootstrap.cc:492] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: No bootstrap required, opened a new log
I20260808 14:42:43.873957 17920 ts_tablet_manager.cc:1397] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:42:43.877888 17920 raft_consensus.cc:348] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:43.878083 17920 raft_consensus.cc:374] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:43.878158 17920 raft_consensus.cc:729] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fd4ae8eb4f4f49afe0f31f091dd984, State: Initialized, Role: FOLLOWER
I20260808 14:42:43.878333 17920 consensus_queue.cc:260] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:43.878739 17920 ts_tablet_manager.cc:1428] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260808 14:42:43.878891 17869 heartbeater.cc:503] Master 127.29.168.254:33477 was elected leader, sending a full tablet report...
W20260808 14:42:43.918979 17457 tablet.cc:2369] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:42:44.044449 17870 tablet.cc:2369] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:42:44.050251 17919 raft_consensus.cc:482] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:44.050390 17919 raft_consensus.cc:504] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:44.050873 17919 leader_election.cc:288] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31fd4ae8eb4f4f49afe0f31f091dd984 (127.29.168.195:41869), f0e10648be354a59b3da432dde7063c9 (127.29.168.194:41889)
I20260808 14:42:44.056087 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:44.051839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:37357 (local address 127.29.168.194:41889)
0808 14:42:44.051886 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:44.051888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:44.052284 (+ 396us) server_negotiation.cc:407] Connection header received
0808 14:42:44.052379 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:44.052380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:44.052393 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:44.052422 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:44.052724 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.053342 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.054830 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.055473 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.055539 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:44.055548 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:44.055959 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 14:42:44.056011 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:42:44.056811 17928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:44.051438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:41889 (local address 127.29.168.193:37357)
0808 14:42:44.052230 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:44.052239 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:44.052307 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:44.052485 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:44.052486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:44.052487 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:44.052643 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:44.052644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.053441 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.053441 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:44.054714 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:44.054717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.055744 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.055745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:44.055846 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:44.055851 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:42:44.056481 (+ 630us) client_negotiation.cc:240] Negotiation successful
0808 14:42:44.056530 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"mutex_wait_us":7,"thread_start_us":172,"threads_started":1}
I20260808 14:42:44.057411 17580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13de7952c3a4131ac6ef8b050aa1936" candidate_uuid: "7859275ba93645c48f6b43cae48f13dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e10648be354a59b3da432dde7063c9" is_pre_election: true
I20260808 14:42:44.057670 17580 raft_consensus.cc:2454] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7859275ba93645c48f6b43cae48f13dd in term 0.
I20260808 14:42:44.058115 17287 leader_election.cc:302] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7859275ba93645c48f6b43cae48f13dd, f0e10648be354a59b3da432dde7063c9; no voters:
I20260808 14:42:44.058274 17919 raft_consensus.cc:2781] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:42:44.058313 17919 raft_consensus.cc:482] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:42:44.058333 17919 raft_consensus.cc:3037] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:44.058355 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:44.051761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:43449 (local address 127.29.168.195:41869)
0808 14:42:44.051819 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:44.051822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:44.052077 (+ 255us) server_negotiation.cc:407] Connection header received
0808 14:42:44.052162 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:44.052164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:44.052173 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:44.052250 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:44.052483 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.053233 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.057260 (+ 4027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.057835 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.057886 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:44.057894 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:44.058200 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 14:42:44.058271 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:42:44.058655 17930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:44.051134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:41869 (local address 127.29.168.193:43449)
0808 14:42:44.052012 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:44.052024 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:44.052095 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:44.052306 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:44.052307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:44.052309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:44.052387 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:44.052389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.053321 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.053322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:44.054715 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:44.054717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.057969 (+ 3252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.057970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:44.058096 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:44.058101 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:42:44.058461 (+ 360us) client_negotiation.cc:240] Negotiation successful
0808 14:42:44.058523 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":24,"thread_start_us":171,"threads_started":1}
I20260808 14:42:44.059116 17800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13de7952c3a4131ac6ef8b050aa1936" candidate_uuid: "7859275ba93645c48f6b43cae48f13dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" is_pre_election: true
I20260808 14:42:44.059245 17800 raft_consensus.cc:2454] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7859275ba93645c48f6b43cae48f13dd in term 0.
I20260808 14:42:44.060124 17919 raft_consensus.cc:504] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:44.060286 17919 leader_election.cc:288] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [CANDIDATE]: Term 1 election: Requested vote from peers 31fd4ae8eb4f4f49afe0f31f091dd984 (127.29.168.195:41869), f0e10648be354a59b3da432dde7063c9 (127.29.168.194:41889)
I20260808 14:42:44.060647 17800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13de7952c3a4131ac6ef8b050aa1936" candidate_uuid: "7859275ba93645c48f6b43cae48f13dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984"
I20260808 14:42:44.060734 17800 raft_consensus.cc:3037] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:44.061947 17800 raft_consensus.cc:2454] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7859275ba93645c48f6b43cae48f13dd in term 1.
I20260808 14:42:44.062144 17285 leader_election.cc:302] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31fd4ae8eb4f4f49afe0f31f091dd984, 7859275ba93645c48f6b43cae48f13dd; no voters:
I20260808 14:42:44.062305 17580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13de7952c3a4131ac6ef8b050aa1936" candidate_uuid: "7859275ba93645c48f6b43cae48f13dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e10648be354a59b3da432dde7063c9"
I20260808 14:42:44.062377 17580 raft_consensus.cc:3037] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:44.063551 17580 raft_consensus.cc:2454] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7859275ba93645c48f6b43cae48f13dd in term 1.
I20260808 14:42:44.063838 17919 raft_consensus.cc:2781] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:42:44.064023 17919 raft_consensus.cc:686] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [term 1 LEADER]: Becoming Leader. State: Replica: 7859275ba93645c48f6b43cae48f13dd, State: Running, Role: LEADER
I20260808 14:42:44.064107 17919 consensus_queue.cc:237] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } }
I20260808 14:42:44.064996 17160 catalog_manager.cc:5495] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 7859275ba93645c48f6b43cae48f13dd (127.29.168.193). New cstate: current_term: 1 leader_uuid: "7859275ba93645c48f6b43cae48f13dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7859275ba93645c48f6b43cae48f13dd" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36595 } health_report { overall_health: HEALTHY } } }
I20260808 14:42:44.079525 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:44.076196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53174 (local address 127.29.168.193:36595)
0808 14:42:44.076277 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:44.076279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:44.076286 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:44.076316 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:44.076317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:44.076333 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:44.076393 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:42:44.076655 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.077401 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.078490 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:44.078776 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:44.078839 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:44.079028 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:42:44.079141 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:42:44.079209 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:44.079439 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 14:42:44.079459 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:42:44.081946 17580 raft_consensus.cc:1261] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 1 FOLLOWER]: Refusing update from remote peer 7859275ba93645c48f6b43cae48f13dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:44.082309 17931 consensus_queue.cc:1035] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e10648be354a59b3da432dde7063c9" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:44.084848 17800 raft_consensus.cc:1261] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 1 FOLLOWER]: Refusing update from remote peer 7859275ba93645c48f6b43cae48f13dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:44.085208 17931 consensus_queue.cc:1035] T c13de7952c3a4131ac6ef8b050aa1936 P 7859275ba93645c48f6b43cae48f13dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fd4ae8eb4f4f49afe0f31f091dd984" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 41869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:44.091272 17934 mvcc.cc:205] Tried to move back new op lower bound from 7316275872076984320 to 7316275872007168000. Current Snapshot: MvccSnapshot[applied={T|T < 7316275872076984320}]
I20260808 14:42:44.091576 17938 mvcc.cc:205] Tried to move back new op lower bound from 7316275872076984320 to 7316275872007168000. Current Snapshot: MvccSnapshot[applied={T|T < 7316275872076984320}]
I20260808 14:42:44.093933 17935 mvcc.cc:205] Tried to move back new op lower bound from 7316275872076984320 to 7316275872007168000. Current Snapshot: MvccSnapshot[applied={T|T < 7316275872076984320}]
I20260808 14:42:44.097616 17160 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:42:44.097715 17160 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:42:44.098487 17160 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc57606876d442faa714931773bb6656: Sending DeleteTablet for 3 replicas of tablet c13de7952c3a4131ac6ef8b050aa1936
I20260808 14:42:44.099016 17535 tablet_service.cc:1514] Processing DeleteTablet for tablet c13de7952c3a4131ac6ef8b050aa1936 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:44 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:36600
I20260808 14:42:44.099457 17361 tablet_service.cc:1514] Processing DeleteTablet for tablet c13de7952c3a4131ac6ef8b050aa1936 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:44 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:53168
I20260808 14:42:44.099987 17768 tablet_service.cc:1514] Processing DeleteTablet for tablet c13de7952c3a4131ac6ef8b050aa1936 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:44 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:57168
I20260808 14:42:44.100666 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 17219
I20260808 14:42:44.111968 17952 tablet_replica.cc:330] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: stopping tablet replica
I20260808 14:42:44.112195 17952 raft_consensus.cc:2229] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:42:44.112437 17952 raft_consensus.cc:2258] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:44.118222 17952 ts_tablet_manager.cc:1905] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:44.118432 17949 tablet_replica.cc:330] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: stopping tablet replica
I20260808 14:42:44.120225 17952 ts_tablet_manager.cc:1918] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:44.120420 17949 raft_consensus.cc:2229] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:42:44.120620 17949 raft_consensus.cc:2258] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:44.120828 17952 log.cc:1196] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/c13de7952c3a4131ac6ef8b050aa1936
I20260808 14:42:44.121275 17949 ts_tablet_manager.cc:1905] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:44.122889 17949 ts_tablet_manager.cc:1918] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:44.123299 17952 ts_tablet_manager.cc:1939] T c13de7952c3a4131ac6ef8b050aa1936 P 31fd4ae8eb4f4f49afe0f31f091dd984: Deleting consensus metadata
I20260808 14:42:44.123842 17137 catalog_manager.cc:4841] TS 31fd4ae8eb4f4f49afe0f31f091dd984 (127.29.168.195:41869): tablet c13de7952c3a4131ac6ef8b050aa1936 (table test-table [id=736b9038e3fb485c94616b71002c43d5]) successfully deleted
I20260808 14:42:44.124068 17949 log.cc:1196] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/c13de7952c3a4131ac6ef8b050aa1936
I20260808 14:42:44.124473 17949 ts_tablet_manager.cc:1939] T c13de7952c3a4131ac6ef8b050aa1936 P f0e10648be354a59b3da432dde7063c9: Deleting consensus metadata
I20260808 14:42:44.125010 17138 catalog_manager.cc:4841] TS f0e10648be354a59b3da432dde7063c9 (127.29.168.194:41889): tablet c13de7952c3a4131ac6ef8b050aa1936 (table test-table [id=736b9038e3fb485c94616b71002c43d5]) successfully deleted
W20260808 14:42:44.125511 17139 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:36595 (error 108)
I20260808 14:42:44.126297 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 17460
I20260808 14:42:44.133219 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:44.133042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:36595 (local address 127.0.0.1:53186)
0808 14:42:44.133133 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:44.133183 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:36595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:42:44.133611 17139 catalog_manager.cc:4584] TS 7859275ba93645c48f6b43cae48f13dd (127.29.168.193:36595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c13de7952c3a4131ac6ef8b050aa1936: Network error: Client connection negotiation failed: client connection to 127.29.168.193:36595: connect: Connection refused (error 111)
I20260808 14:42:44.139511 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 17666
I20260808 14:42:44.159312 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 17102
I20260808 14:42:44.169409 30371 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:42:44.515353 30371 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:42:44.515450 30371 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:42:44.860426 30371 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:42:44.860 UTC [15711] LOG: received smart shutdown request
2026-08-08 14:42:44.864 UTC [15711] LOG: background worker "logical replication launcher" (PID 15722) exited with exit code 1
2026-08-08 14:42:44.864 UTC [15715] LOG: shutting down
2026-08-08 14:42:44.999 UTC [15711] LOG: database system is shut down
2026-08-08T14:42:44Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45655 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:42:45 dist-test-slave-mjjr krb5kdc[17966](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:42:45 dist-test-slave-mjjr krb5kdc[17966](info): set up 2 sockets
Aug 08 14:42:45 dist-test-slave-mjjr krb5kdc[17966](info): commencing operation
krb5kdc: starting...
W20260808 14:42:46.306277 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:42:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:42:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:42:46.419732 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44333
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44333,127.29.168.253:37801,127.29.168.252:35099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:46.499140 17983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:46.499310 17983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:46.499329 17983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:46.500381 17983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:46.500423 17983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:46.500437 17983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:46.500455 17983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:46.500468 17983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:46.501902 17983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44333,127.29.168.253:37801,127.29.168.252:35099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:46.502077 17983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:46.502236 17983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:46.506990 17989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:46.506990 17990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:46.507030 17994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:46.507277 17983 server_base.cc:1034] running on GCE node
I20260808 14:42:46.507510 17983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:46.507838 17983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:46.508978 17983 hybrid_clock.cc:648] HybridClock initialized: now 1786200166508963 us; error 26 us; skew 500 ppm
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:46.511368 17983 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:46.511762 17983 webserver.cc:460] Webserver started at http://127.29.168.254:42425/ using document root <none> and password file <none>
I20260808 14:42:46.511945 17983 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:46.511978 17983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:46.512072 17983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:46.512914 17983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "17b9e2d58e557e39d1717bc71ed8698c"
server_key_iv: "29d75204e1f3f770ef5c8775c2c5fc34"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.513195 17983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "17b9e2d58e557e39d1717bc71ed8698c"
server_key_iv: "29d75204e1f3f770ef5c8775c2c5fc34"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.514463 17983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:42:46.515100 18003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:46.515283 17983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:42:46.515393 17983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "17b9e2d58e557e39d1717bc71ed8698c"
server_key_iv: "29d75204e1f3f770ef5c8775c2c5fc34"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.515467 17983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:46.542878 17983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:46.545080 17983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:46.545243 17983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:46.549460 17983 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:44333
I20260808 14:42:46.549500 18085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:44333 every 8 connection(s)
I20260808 14:42:46.549839 17983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:46.550657 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:46.552165 18086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:42:46.553881 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 17983
I20260808 14:42:46.553992 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:42:46.554219 30371 external_mini_cluster.cc:1428] Setting key 3d93c8ffa47f5413fb5b51ed34f243a6
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:46.561982 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.552734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.29.168.254:44333)
0808 14:42:46.552932 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.552935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.552959 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:42:46.553400 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.553402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.553417 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.553486 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.554020 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.555280 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.556449 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.556751 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.556846 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.558988 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.558996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.558996 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.559003 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.560513 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.561003 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.561004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.561005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.561070 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.561301 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.561302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.561302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.561481 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.561534 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.561763 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.561848 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":74,"threads_started":1}
I20260808 14:42:46.562093 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.552705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44333 (local address 127.0.0.1:59890)
0808 14:42:46.552868 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.552897 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.553280 (+ 383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.553534 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.553536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.553751 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.553895 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.553899 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.555386 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.555387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.556356 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.556359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.556844 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.556845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.556917 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.557327 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.557336 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.558896 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.560602 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.560610 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.560612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.560894 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.561135 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.561136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.561136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.561242 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.561543 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.561550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.561622 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.561737 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.561943 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":61,"thread_start_us":89,"threads_started":1}
I20260808 14:42:46.562777 18086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:42:46.563114 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.562993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51894)
0808 14:42:46.563043 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.563091 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:42:46.563249 18007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.29.168.253@KRBTEST.COM; defaulting to no policy
I20260808 14:42:46.563752 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.563612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51908)
0808 14:42:46.563692 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.563723 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 14:42:46.563858 18086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:37801: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab.
Entry for principal kudu/127.29.168.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab.
I20260808 14:42:46.578718 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:37801
--webserver_interface=127.29.168.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab
--principal=kudu/127.29.168.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44333,127.29.168.253:37801,127.29.168.252:35099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:46.613035 18086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } attempt: 1
I20260808 14:42:46.613556 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.613430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51916)
0808 14:42:46.613488 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.613525 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:42:46.613967 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.613853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51924)
0808 14:42:46.613917 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.613943 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:42:46.614152 18086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:37801: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
W20260808 14:42:46.665330 18094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:46.665524 18094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:46.665547 18094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:46.666703 18094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:46.666757 18094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:46.666774 18094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:46.666823 18094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:46.666855 18094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:46.668418 18094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44333,127.29.168.253:37801,127.29.168.252:35099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab
--principal=kudu/127.29.168.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:37801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.168.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:46.668675 18094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:46.668900 18094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:46.673449 18100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:46.673415 18099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:46.673560 18094 server_base.cc:1034] running on GCE node
W20260808 14:42:46.673664 18103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:46.673926 18094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:46.674243 18094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:46.675396 18094 hybrid_clock.cc:648] HybridClock initialized: now 1786200166675382 us; error 36 us; skew 500 ppm
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:46.678052 18094 init.cc:377] Logged in from keytab as kudu/127.29.168.253@KRBTEST.COM (short username kudu)
I20260808 14:42:46.678478 18094 webserver.cc:460] Webserver started at http://127.29.168.253:35695/ using document root <none> and password file <none>
I20260808 14:42:46.678705 18094 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:46.678771 18094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:46.678920 18094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:46.679947 18094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data/instance:
uuid: "0500e6f5b76f4e28b35fd090a9c5a937"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "16494815e50f25c68ec473a01bb556fe"
server_key_iv: "1423daa0047c8b76286d629d7c2679e3"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.680296 18094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal/instance:
uuid: "0500e6f5b76f4e28b35fd090a9c5a937"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "16494815e50f25c68ec473a01bb556fe"
server_key_iv: "1423daa0047c8b76286d629d7c2679e3"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.681514 18094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:42:46.682185 18116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:46.682300 18086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } attempt: 2
I20260808 14:42:46.682369 18094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:42:46.682474 18094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal
uuid: "0500e6f5b76f4e28b35fd090a9c5a937"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "16494815e50f25c68ec473a01bb556fe"
server_key_iv: "1423daa0047c8b76286d629d7c2679e3"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.682538 18094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:46.682631 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.682523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51926)
0808 14:42:46.682576 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.682608 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:42:46.682957 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.682878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51934)
0808 14:42:46.682917 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.682938 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:42:46.683058 18086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:37801: Network error: Client connection negotiation failed: client connection to 127.29.168.253:37801: connect: Connection refused (error 111)
I20260808 14:42:46.717489 18094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:46.719304 18094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:46.719457 18094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:46.723454 18094 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.253:37801
I20260808 14:42:46.723529 18193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.253:37801 every 8 connection(s)
I20260808 14:42:46.723845 18094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
I20260808 14:42:46.724715 18194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:46.726155 18194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:46.733708 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 18094
I20260808 14:42:46.733825 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-1/wal/instance
I20260808 14:42:46.734011 30371 external_mini_cluster.cc:1428] Setting key 3c63623fcf250feca4ee598a319f7cd4
I20260808 14:42:46.734304 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.726849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.29.168.254:44333)
0808 14:42:46.726894 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.726896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.727092 (+ 196us) server_negotiation.cc:407] Connection header received
0808 14:42:46.727499 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.727500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.727510 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.727565 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.728238 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.728725 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.729615 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.729802 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.729851 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.731858 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.731859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.731859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.731866 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.732996 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.733337 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.733338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.733338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.733381 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.733585 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.733586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.733586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.733732 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.733814 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.734135 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.734221 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:42:46.734469 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.726799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44333 (local address 127.0.0.1:59892)
0808 14:42:46.726962 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.727001 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.727423 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.727721 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.727725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.727982 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.728160 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.728164 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.728805 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.728806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.729547 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.729549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.729871 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.729872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.729965 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.730440 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.730448 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.731780 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.733059 (+ 1279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.733065 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.733067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.733265 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.733432 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.733432 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.733432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.733533 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.733808 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.733816 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.733978 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.734082 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.734247 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260808 14:42:46.735105 18194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:42:46.741667 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.735414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51944 (local address 127.29.168.253:37801)
0808 14:42:46.735562 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.735566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.735590 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:42:46.735605 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.735606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.735615 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.735714 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.735997 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.736597 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.737273 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.737523 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.737584 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.739248 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.739257 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.739257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.739264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.740668 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.741024 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.741026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.741026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.741071 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.741254 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.741254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.741254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.741357 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.741409 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.741551 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.741608 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260808 14:42:46.741786 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.735342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51944)
0808 14:42:46.735391 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.735402 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.735476 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.735714 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.735715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.735853 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.735904 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.735906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.736695 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.736696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.737203 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.737205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.737601 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.737602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.737672 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.737961 (+ 289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.737965 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.739168 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.740745 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.740746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.740746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.740946 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.741134 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.741135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.741136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.741199 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.741418 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.741419 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.741461 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.741533 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.741667 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":47}
I20260808 14:42:46.742344 18194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:42:46.742654 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.742559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48556)
0808 14:42:46.742601 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.742637 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:42:46.742816 18121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
I20260808 14:42:46.743217 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.743138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48568)
0808 14:42:46.743181 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.743202 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
WARNING: no policy specified for kudu/127.29.168.252@KRBTEST.COM; defaulting to no policy
W20260808 14:42:46.743351 18194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:35099: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab.
Entry for principal kudu/127.29.168.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab.
I20260808 14:42:46.758334 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:35099
--webserver_interface=127.29.168.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab
--principal=kudu/127.29.168.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44333,127.29.168.253:37801,127.29.168.252:35099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:46.774231 18086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } attempt: 3
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:42:46.780907 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.774544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51954)
0808 14:42:46.774610 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.774620 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.774688 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.774843 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.774844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.774997 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.775057 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.775059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.775801 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.775802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.776288 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.776290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.776723 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.776725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.776802 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.777228 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.777232 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.778385 (+ 1153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.780083 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.780083 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.780084 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.780233 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.780422 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.780422 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.780423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.780474 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.780707 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.780707 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.780739 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.780785 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.780848 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:42:46.780957 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.774609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51954 (local address 127.29.168.253:37801)
0808 14:42:46.774675 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.774678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.774688 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:42:46.774752 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.774753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.774764 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.774835 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.775143 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.775706 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.776389 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.776633 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.776722 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.778492 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.778493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.778494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.778502 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.779995 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.780299 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.780300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.780300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.780357 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.780532 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.780532 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.780533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.780649 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.780712 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.780804 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.780880 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:42:46.781327 18086 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:42:46.781716 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.781608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48576)
0808 14:42:46.781662 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.781694 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:42:46.782101 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.782009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48582)
0808 14:42:46.782055 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.782083 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:42:46.782196 18086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:35099: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
I20260808 14:42:46.792557 18194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } attempt: 1
I20260808 14:42:46.792912 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.792797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48592)
0808 14:42:46.792854 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.792889 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:42:46.793223 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.793137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48598)
0808 14:42:46.793180 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.793201 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:42:46.793310 18194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:35099: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
I20260808 14:42:46.813333 18086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } attempt: 1
I20260808 14:42:46.813712 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.813604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48606)
0808 14:42:46.813658 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.813690 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:42:46.814047 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.813959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48608)
0808 14:42:46.814004 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.814028 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:42:46.814203 18086 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:35099: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
W20260808 14:42:46.839845 18205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:46.840023 18205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:46.840054 18205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:46.841077 18205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:46.841152 18205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:46.841176 18205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:46.841207 18205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:46.841226 18205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:46.842573 18205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44333,127.29.168.253:37801,127.29.168.252:35099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab
--principal=kudu/127.29.168.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:35099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.168.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:46.842842 18205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:46.843042 18205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:46.847697 18210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:46.847718 18211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:46.847949 18205 server_base.cc:1034] running on GCE node
W20260808 14:42:46.847698 18213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:46.848238 18205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:46.848519 18205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:46.849653 18205 hybrid_clock.cc:648] HybridClock initialized: now 1786200166849644 us; error 25 us; skew 500 ppm
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:46.851964 18205 init.cc:377] Logged in from keytab as kudu/127.29.168.252@KRBTEST.COM (short username kudu)
I20260808 14:42:46.852435 18205 webserver.cc:460] Webserver started at http://127.29.168.252:35981/ using document root <none> and password file <none>
I20260808 14:42:46.852656 18205 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:46.852700 18205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:46.852861 18205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:46.853845 18205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data/instance:
uuid: "0bed1851fa7546e7b222a7a03d78bbbc"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "9c68d4a7ddbb716f73df3c4ec2206414"
server_key_iv: "8af7cf4d66132516967627915fa04c8b"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.854218 18205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal/instance:
uuid: "0bed1851fa7546e7b222a7a03d78bbbc"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "9c68d4a7ddbb716f73df3c4ec2206414"
server_key_iv: "8af7cf4d66132516967627915fa04c8b"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.855504 18205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:42:46.856248 18226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:46.856436 18205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:46.856528 18205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal
uuid: "0bed1851fa7546e7b222a7a03d78bbbc"
format_stamp: "Formatted at 2026-08-08 14:42:46 on dist-test-slave-mjjr"
server_key: "9c68d4a7ddbb716f73df3c4ec2206414"
server_key_iv: "8af7cf4d66132516967627915fa04c8b"
server_key_version: "encryptionkey@0"
I20260808 14:42:46.856599 18205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:46.861455 18194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } attempt: 2
I20260808 14:42:46.861788 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.861685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48624)
0808 14:42:46.861734 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.861762 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:42:46.862094 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.861996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48626)
0808 14:42:46.862034 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.862079 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:42:46.862174 18194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:35099: Network error: Client connection negotiation failed: client connection to 127.29.168.252:35099: connect: Connection refused (error 111)
I20260808 14:42:46.866916 18205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:46.868625 18205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:46.868769 18205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:46.872725 18205 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.252:35099
I20260808 14:42:46.872761 18305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.252:35099 every 8 connection(s)
I20260808 14:42:46.873067 18205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
I20260808 14:42:46.873761 18306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:46.875162 18306 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:46.882757 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.875867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59908 (local address 127.29.168.254:44333)
0808 14:42:46.875924 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.875926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.876079 (+ 153us) server_negotiation.cc:407] Connection header received
0808 14:42:46.876480 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.876481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.876490 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.876543 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.877064 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.877507 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.878394 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.878579 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.878628 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.880555 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.880556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.880557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.880564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.881656 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.881987 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.882005 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.882005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.882052 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.882280 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.882281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.882281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.882372 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.882419 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.882624 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.882683 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:42:46.882894 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 18205
I20260808 14:42:46.882959 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.875813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44333 (local address 127.0.0.1:59908)
0808 14:42:46.875960 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.875997 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.876403 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.876587 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.876590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.876802 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.876999 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.877002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.877587 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.877588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.878325 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.878327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.878648 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.878649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.878794 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.879184 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.879191 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.880469 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.881722 (+ 1253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.881728 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.881730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.881922 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.882139 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.882140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.882140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.882228 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.882424 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.882428 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.882524 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.882596 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.882697 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
I20260808 14:42:46.883004 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200015623817-30371-0/minicluster-data/master-2/wal/instance
I20260808 14:42:46.883180 30371 external_mini_cluster.cc:1428] Setting key b642fe8df7915b4559f51664e80a4e3e
I20260808 14:42:46.883653 18306 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:42:46.889379 18086 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } attempt: 2
I20260808 14:42:46.890815 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.883943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:37801 (local address 127.0.0.1:51970)
0808 14:42:46.883979 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.883987 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.884017 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.884199 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.884200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.884338 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.884379 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.884381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.885028 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.885029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.885604 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.885606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.885915 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.885916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.885984 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.886352 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.886357 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.887815 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.889445 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.889447 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.889447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.889726 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.890169 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.890170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.890171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.890251 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.890508 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.890508 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.890546 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.890617 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.890736 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:42:46.890831 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.884005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.29.168.253:37801)
0808 14:42:46.884046 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.884048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.884055 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:46.884100 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.884101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.884133 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.884195 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.884459 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.884948 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.885666 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.885848 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.885918 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.887897 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.887898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.887898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.887904 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.889342 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.890038 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.890040 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.890040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.890102 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.890311 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.890312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.890313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.890436 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.890503 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.890660 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.890734 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:42:46.891476 18306 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:42:46.892258 18310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.883615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48628 (local address 127.29.168.252:35099)
0808 14:42:46.883783 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.883787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.883812 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:42:46.883834 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.883835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.883846 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.883912 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.884569 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.885261 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.886006 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.886410 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.886556 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.889013 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.889022 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.889023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.889030 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.890888 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.891290 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.891292 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.891293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.891348 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.891648 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.891649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.891650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.891821 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.892016 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.892059 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.892152 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:42:46.897464 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.889631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48640)
0808 14:42:46.889674 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.889683 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.889719 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.889976 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.889977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.890129 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.890171 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.890173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.891000 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.891001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.891790 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.891793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.892285 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.892286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.892342 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.892712 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.892716 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.894042 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.896354 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.896355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.896356 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.896600 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.896797 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.896798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.896798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.896867 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.897135 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.897136 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.897177 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.897265 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.897356 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:42:46.897747 18312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.889687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48640 (local address 127.29.168.252:35099)
0808 14:42:46.889820 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.889834 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.889841 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:46.889858 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.889858 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.889866 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.889931 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.890263 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.890870 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.891887 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.892224 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.892285 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.894162 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.894163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.894164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.894171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.896275 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.896687 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.896688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.896688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.896739 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.896933 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.896934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.896935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.897064 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.897126 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.897307 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.897395 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:46.899308 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.892000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48644)
0808 14:42:46.892302 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.892313 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.892356 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.892508 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.892509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.892682 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.892713 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.892714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.893840 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.893840 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.894576 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.894578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.895028 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.895029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.895072 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.895359 (+ 287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.895363 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.896396 (+ 1033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.898165 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.898166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.898167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.898463 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.898686 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.898687 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.898688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.898763 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.899076 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.899077 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.899120 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.899184 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.899260 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286}
I20260808 14:42:46.899626 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.892060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.29.168.252:35099)
0808 14:42:46.892186 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.892188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.892409 (+ 221us) server_negotiation.cc:407] Connection header received
0808 14:42:46.892426 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.892426 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.892434 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.892500 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.892889 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.893741 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.894654 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.894932 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.894983 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.896473 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.896474 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.896475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.896480 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.898066 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.898542 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.898543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.898543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.898610 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.898851 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.898852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.898852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.899000 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.899067 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.899480 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.899543 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260808 14:42:46.899932 18086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: Bootstrap starting.
I20260808 14:42:46.900736 18086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:46.901098 18086 log.cc:824] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:46.901907 18086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: No bootstrap required, opened a new log
I20260808 14:42:46.902431 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.893160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59916 (local address 127.29.168.254:44333)
0808 14:42:46.893198 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.893200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.893208 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:42:46.893229 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.893230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.893240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.893300 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.894283 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.894940 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.896217 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.896484 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.896538 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.899550 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.899551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.899552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.899558 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.901062 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.901436 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.901437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.901437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.901541 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.901743 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.901744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.901745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.901871 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.902013 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.902237 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.902329 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:42:46.902676 18306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: Bootstrap starting.
I20260808 14:42:46.903385 18306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:46.903849 18306 log.cc:824] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:46.903959 18086 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:46.904129 18086 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:46.904201 18086 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea6cd672aa2040e09999a6b3ac0cbfa6, State: Initialized, Role: FOLLOWER
I20260808 14:42:46.904348 18086 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:46.904650 18306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: No bootstrap required, opened a new log
I20260808 14:42:46.904619 18318 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:46.904667 18086 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:46.904695 18318 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:42:46.906594 18343 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:42:46.906638 18343 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:42:46.906631 18306 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:46.906770 18306 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:46.906808 18306 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bed1851fa7546e7b222a7a03d78bbbc, State: Initialized, Role: FOLLOWER
I20260808 14:42:46.906998 18306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:46.907382 18306 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
W20260808 14:42:46.910249 18363 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:42:46.910346 18363 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:42:46.907486 17983 master_runner.cc:186] Error getting master registration for 127.29.168.253:37801: OK, instance_id { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" instance_seqno: 1786200166722299 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:42:46.910398 17983 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:42:46.912242 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.903370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51980 (local address 127.29.168.253:37801)
0808 14:42:46.903406 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.903407 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.903415 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:42:46.903470 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.903471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.903479 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.903533 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.904207 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.904860 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.905776 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.906046 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.906088 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.908906 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.908908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.908908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.908915 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.910871 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.911314 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.911315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.911315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.911372 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.911589 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.911590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.911590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.911751 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.911868 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.912076 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.912149 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:42:46.913606 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:42:46.911357 18205 master_runner.cc:186] Error getting master registration for 127.29.168.253:37801: OK, instance_id { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" instance_seqno: 1786200166722299 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:42:46.913714 18205 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:42:46.917671 18345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:46.917816 18345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:42:46.922439 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.915277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59926 (local address 127.29.168.254:44333)
0808 14:42:46.915334 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.915347 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.915354 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:46.915372 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.915372 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.915380 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.915425 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.916077 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.916737 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.917689 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.917984 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.918021 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.919524 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.919525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.919526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.919532 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.921216 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.921581 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.921582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.921583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.921642 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.921843 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.921844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.921844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.921963 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.922048 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.922272 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.922345 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:42:46.924309 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.914969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.29.168.252:35099)
0808 14:42:46.915245 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.915246 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.915976 (+ 730us) server_negotiation.cc:407] Connection header received
0808 14:42:46.916068 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.916069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.916078 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.916105 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.916694 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.917410 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.918720 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.919132 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.919181 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.921165 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.921166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.921167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.921173 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.922827 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.923225 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.923226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.923226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.923375 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.923644 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.923645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.923646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.923849 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.923928 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.924144 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.924223 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254}
I20260808 14:42:46.929262 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.915151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.29.168.253:37801)
0808 14:42:46.915187 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.915189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.923146 (+ 7957us) server_negotiation.cc:407] Connection header received
0808 14:42:46.923239 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.923240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.923250 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.923280 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.923922 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.924600 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.925397 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.925591 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.925699 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.926798 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.926799 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.926799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.926806 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.928169 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.928511 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.928512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.928512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.928564 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.928771 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.928772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.928773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.928875 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.928969 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.929086 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.929154 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:42:46.953293 18194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } attempt: 3
Aug 08 14:42:46 dist-test-slave-mjjr krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200166, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:42:46.959590 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.953563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:35099 (local address 127.0.0.1:48664)
0808 14:42:46.953613 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:46.953624 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:46.953664 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:46.953778 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:46.953779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:46.953914 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:46.953947 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.953948 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.954567 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.954568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.955042 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:46.955044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.955420 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.955421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:46.955488 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.955907 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:46.955912 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:46.957042 (+ 1130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:46.958544 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.958545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.958546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.958761 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.958935 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:46.958936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:46.958936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:46.959019 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:46.959237 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:46.959238 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:46.959279 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:42:46.959366 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:42:46.959474 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:42:46.959980 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:46.953649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48664 (local address 127.29.168.252:35099)
0808 14:42:46.953685 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:46.953687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:46.953694 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:46.953713 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:46.953714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:46.953723 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:46.953766 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:46.954020 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.954481 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.955136 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:46.955340 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:46.955419 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:46.957126 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:46.957127 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:46.957128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:46.957135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:46.958462 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.958812 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.958814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.958814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.958868 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:46.959074 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:46.959075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:46.959075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:46.959172 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:46.959243 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:46.959774 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 14:42:46.959857 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:42:46.961922 18194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: Bootstrap starting.
I20260808 14:42:46.962667 18194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:46.962997 18194 log.cc:824] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:46.963914 18194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: No bootstrap required, opened a new log
I20260808 14:42:46.965307 18194 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:46.965461 18194 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:46.965523 18194 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0500e6f5b76f4e28b35fd090a9c5a937, State: Initialized, Role: FOLLOWER
I20260808 14:42:46.965664 18194 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:46.965939 18377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:46.966012 18194 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:46.966082 18377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:42:46.968603 18392 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:42:46.968708 18392 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:42:46.969882 18094 master_runner.cc:263] No leader master found from master 0500e6f5b76f4e28b35fd090a9c5a937
I20260808 14:42:46.969928 18094 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 14:42:46.970145 18126 tablet.cc:2369] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:42:47.045995 18011 tablet.cc:2369] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:42:47.119314 18235 tablet.cc:2369] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:42:47.152076 18345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:47.152245 18345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:47.152541 18345 leader_election.cc:288] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea6cd672aa2040e09999a6b3ac0cbfa6 (127.29.168.254:44333), 0500e6f5b76f4e28b35fd090a9c5a937 (127.29.168.253:37801)
I20260808 14:42:47.152817 18044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" is_pre_election: true
I20260808 14:42:47.152848 18160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" is_pre_election: true
I20260808 14:42:47.152956 18044 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bed1851fa7546e7b222a7a03d78bbbc in term 0.
I20260808 14:42:47.153007 18160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bed1851fa7546e7b222a7a03d78bbbc in term 0.
I20260808 14:42:47.153187 18229 leader_election.cc:302] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bed1851fa7546e7b222a7a03d78bbbc, ea6cd672aa2040e09999a6b3ac0cbfa6; no voters:
I20260808 14:42:47.153340 18345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:42:47.153419 18345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:42:47.153447 18345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:47.154217 18345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:47.154356 18345 leader_election.cc:288] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [CANDIDATE]: Term 1 election: Requested vote from peers ea6cd672aa2040e09999a6b3ac0cbfa6 (127.29.168.254:44333), 0500e6f5b76f4e28b35fd090a9c5a937 (127.29.168.253:37801)
I20260808 14:42:47.154536 18044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6"
I20260808 14:42:47.154538 18160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0500e6f5b76f4e28b35fd090a9c5a937"
I20260808 14:42:47.154620 18044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:47.154619 18160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:47.155500 18160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bed1851fa7546e7b222a7a03d78bbbc in term 1.
I20260808 14:42:47.155500 18044 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bed1851fa7546e7b222a7a03d78bbbc in term 1.
I20260808 14:42:47.155735 18229 leader_election.cc:302] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0500e6f5b76f4e28b35fd090a9c5a937, 0bed1851fa7546e7b222a7a03d78bbbc; no voters:
I20260808 14:42:47.155817 18345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:42:47.155997 18345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [term 1 LEADER]: Becoming Leader. State: Replica: 0bed1851fa7546e7b222a7a03d78bbbc, State: Running, Role: LEADER
I20260808 14:42:47.156111 18345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } }
I20260808 14:42:47.156541 18394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bed1851fa7546e7b222a7a03d78bbbc. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.156633 18394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:47.156849 18400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:47.157039 18400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:47.158344 18160 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [term 1 FOLLOWER]: Refusing update from remote peer 0bed1851fa7546e7b222a7a03d78bbbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:47.158357 18044 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [term 1 FOLLOWER]: Refusing update from remote peer 0bed1851fa7546e7b222a7a03d78bbbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:47.158638 18394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:47.158748 18345 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:47.159988 18318 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bed1851fa7546e7b222a7a03d78bbbc. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.159991 18377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bed1851fa7546e7b222a7a03d78bbbc. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.160079 18318 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:42:47.160079 18377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:42:47.160933 18345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.161026 18345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:47.161070 18345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.161104 18345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:47.161134 18402 mvcc.cc:205] Tried to move back new op lower bound from 7316275884678406144 to 7316275884672016384. Current Snapshot: MvccSnapshot[applied={T|T < 7316275884678406144}]
I20260808 14:42:47.161201 18318 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.161280 18318 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:42:47.161360 18403 mvcc.cc:205] Tried to move back new op lower bound from 7316275884678406144 to 7316275884672016384. Current Snapshot: MvccSnapshot[applied={T|T < 7316275884678406144}]
I20260808 14:42:47.161473 18400 catalog_manager.cc:1347] Generated new cluster ID: c86a62c92f5b44d2b5e46a93f831319e
I20260808 14:42:47.161449 18377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea6cd672aa2040e09999a6b3ac0cbfa6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44333 } } peers { permanent_uuid: "0500e6f5b76f4e28b35fd090a9c5a937" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 37801 } } peers { permanent_uuid: "0bed1851fa7546e7b222a7a03d78bbbc" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 35099 } } }
I20260808 14:42:47.161516 18377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:42:47.161523 18400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:42:47.172148 18400 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:42:47.172633 18400 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:42:47.175436 18400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bed1851fa7546e7b222a7a03d78bbbc: Generated new TSK 0
I20260808 14:42:47.175707 18400 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:42:47.907116 18343 catalog_manager.cc:1259] Loaded cluster ID: c86a62c92f5b44d2b5e46a93f831319e
I20260808 14:42:47.907176 18343 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: loading cluster ID for follower catalog manager: success
I20260808 14:42:47.908114 18343 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: acquiring CA information for follower catalog manager: success
I20260808 14:42:47.908394 18343 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ea6cd672aa2040e09999a6b3ac0cbfa6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:42:47.969162 18392 catalog_manager.cc:1259] Loaded cluster ID: c86a62c92f5b44d2b5e46a93f831319e
I20260808 14:42:47.969265 18392 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: loading cluster ID for follower catalog manager: success
I20260808 14:42:47.970065 18392 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: acquiring CA information for follower catalog manager: success
I20260808 14:42:47.970399 18392 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0500e6f5b76f4e28b35fd090a9c5a937: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:42:48.221107 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 17983
I20260808 14:42:48.231415 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 18094
I20260808 14:42:48.239603 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 18205
2026-08-08T14:42:48Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3130 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:42:48 dist-test-slave-mjjr krb5kdc[18419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:42:48 dist-test-slave-mjjr krb5kdc[18419](info): set up 2 sockets
Aug 08 14:42:48 dist-test-slave-mjjr krb5kdc[18419](info): commencing operation
krb5kdc: starting...
W20260808 14:42:49.411898 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:42:49 dist-test-slave-mjjr krb5kdc[18419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:42:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:42:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:42:49.631163 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36153
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:34919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:36153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:49.903606 18442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:49.904227 18442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:49.904327 18442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:49.907605 18442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:49.907922 18442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:49.908063 18442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:49.908237 18442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:49.908357 18442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:49.912765 18442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:36153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:49.913815 18442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:49.914232 18442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:49.926307 18451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:49.926362 18450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:49.926314 18455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:49.927721 18442 server_base.cc:1034] running on GCE node
I20260808 14:42:49.928817 18442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:49.930037 18442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:49.931363 18442 hybrid_clock.cc:648] HybridClock initialized: now 1786200169931305 us; error 90 us; skew 500 ppm
Aug 08 14:42:49 dist-test-slave-mjjr krb5kdc[18419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200169, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:49.938333 18442 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:49.940047 18442 webserver.cc:460] Webserver started at http://127.29.168.254:38763/ using document root <none> and password file <none>
I20260808 14:42:49.940935 18442 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:49.941176 18442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:49.941861 18442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:49.946075 18442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "fb0cf82ff9534e4381e06f424fe6bf92"
format_stamp: "Formatted at 2026-08-08 14:42:49 on dist-test-slave-mjjr"
server_key: "99b100d20d50ad4421ba7db38cb83320"
server_key_iv: "eca79d5f80710b044bb93affd33bb23c"
server_key_version: "encryptionkey@0"
I20260808 14:42:49.946846 18442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "fb0cf82ff9534e4381e06f424fe6bf92"
format_stamp: "Formatted at 2026-08-08 14:42:49 on dist-test-slave-mjjr"
server_key: "99b100d20d50ad4421ba7db38cb83320"
server_key_iv: "eca79d5f80710b044bb93affd33bb23c"
server_key_version: "encryptionkey@0"
I20260808 14:42:49.952574 18442 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:42:49.954082 18466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:49.954546 18442 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:49.954708 18442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "fb0cf82ff9534e4381e06f424fe6bf92"
format_stamp: "Formatted at 2026-08-08 14:42:49 on dist-test-slave-mjjr"
server_key: "99b100d20d50ad4421ba7db38cb83320"
server_key_iv: "eca79d5f80710b044bb93affd33bb23c"
server_key_version: "encryptionkey@0"
I20260808 14:42:49.954843 18442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:49.982931 18442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:49.991513 18442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:49.992063 18442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:50.004621 18442 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:36153
I20260808 14:42:50.004829 18539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:36153 every 8 connection(s)
I20260808 14:42:50.006104 18442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:50.006562 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 18442
I20260808 14:42:50.006826 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:42:50.007618 30371 external_mini_cluster.cc:1428] Setting key b39b2af8277a876e0b905799a692190a
I20260808 14:42:50.009152 18540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:50.019588 18540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92: Bootstrap starting.
I20260808 14:42:50.021373 18540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:50.022265 18540 log.cc:824] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:50.023839 18540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92: No bootstrap required, opened a new log
Aug 08 14:42:50 dist-test-slave-mjjr krb5kdc[18419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:50.029151 18540 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36153 } }
I20260808 14:42:50.029734 18540 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:50.029824 18540 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb0cf82ff9534e4381e06f424fe6bf92, State: Initialized, Role: FOLLOWER
I20260808 14:42:50.030326 18540 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36153 } }
I20260808 14:42:50.030566 18540 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:42:50.030680 18540 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:42:50.030900 18540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:50.032634 18540 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36153 } }
I20260808 14:42:50.033015 18540 leader_election.cc:302] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb0cf82ff9534e4381e06f424fe6bf92; no voters:
I20260808 14:42:50.033521 18540 leader_election.cc:288] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:42:50.033743 18547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:42:50.034266 18547 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [term 1 LEADER]: Becoming Leader. State: Replica: fb0cf82ff9534e4381e06f424fe6bf92, State: Running, Role: LEADER
I20260808 14:42:50.034600 18540 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:50.034758 18547 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36153 } }
I20260808 14:42:50.037202 18549 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb0cf82ff9534e4381e06f424fe6bf92. Latest consensus state: current_term: 1 leader_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36153 } } }
I20260808 14:42:50.037202 18548 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0cf82ff9534e4381e06f424fe6bf92" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36153 } } }
I20260808 14:42:50.037647 18549 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:50.037736 18548 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92 [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:50.040023 18543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:50.009207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60626 (local address 127.29.168.254:36153)
0808 14:42:50.009705 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:50.009734 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:50.009786 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:42:50.010727 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:50.010757 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:50.010958 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:50.011167 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:50.013446 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:50.016149 (+ 2703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:50.019579 (+ 3430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:50.020791 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:50.021273 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:50.027305 (+ 6032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:50.027323 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:50.027324 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:50.027343 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:50.032169 (+ 4826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:50.033214 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:50.033235 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:50.033236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:50.033454 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:50.034546 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:50.034555 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:50.034556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:50.035891 (+ 1335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:50.036468 (+ 577us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:50.038461 (+ 1993us) server_negotiation.cc:299] Negotiation successful
0808 14:42:50.039000 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":265,"threads_started":1}
W20260808 14:42:50.041610 18568 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:42:50.042448 18568 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:42:50.042632 18560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:50.043083 18560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:50.043891 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:42:50.047631 18560 catalog_manager.cc:1347] Generated new cluster ID: eadde49e82504479a03f125aed4bcdef
I20260808 14:42:50.047895 18560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:42:50.056558 18560 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:42:50.057528 18560 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:42:50.070032 18560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb0cf82ff9534e4381e06f424fe6bf92: Generated new TSK 0
I20260808 14:42:50.070479 18560 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:42:50.105347 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 18442
2026-08-08T14:42:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1890 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:42:50 dist-test-slave-mjjr krb5kdc[18576](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:42:50 dist-test-slave-mjjr krb5kdc[18576](info): set up 2 sockets
Aug 08 14:42:50 dist-test-slave-mjjr krb5kdc[18576](info): commencing operation
krb5kdc: starting...
W20260808 14:42:51.325256 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:42:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:42:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:42:51.434048 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41411
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:51.511534 18593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:51.511759 18593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:51.511796 18593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:51.512849 18593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:51.512912 18593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:51.512933 18593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:51.512952 18593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:51.512979 18593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:51.514282 18593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:51.514551 18593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:51.514807 18593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:51.519230 18599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:51.519238 18602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:51.519238 18605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:51.519455 18593 server_base.cc:1034] running on GCE node
I20260808 14:42:51.519807 18593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:51.520087 18593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:51.521255 18593 hybrid_clock.cc:648] HybridClock initialized: now 1786200171521241 us; error 24 us; skew 500 ppm
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:51.528247 18593 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:51.528599 18593 webserver.cc:460] Webserver started at http://127.29.168.254:44987/ using document root <none> and password file <none>
I20260808 14:42:51.528784 18593 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:51.528821 18593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:51.528900 18593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:51.529827 18593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "34c1e17e178540e0953b14429bc4ff0e"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "f1b465de2da36b4ad31b5acbec6b54cf"
server_key_iv: "d09cc5d218b24ffa0ba1932dcf8c3135"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.530122 18593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "34c1e17e178540e0953b14429bc4ff0e"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "f1b465de2da36b4ad31b5acbec6b54cf"
server_key_iv: "d09cc5d218b24ffa0ba1932dcf8c3135"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.531234 18593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:42:51.531891 18615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.532054 18593 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.532130 18593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "34c1e17e178540e0953b14429bc4ff0e"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "f1b465de2da36b4ad31b5acbec6b54cf"
server_key_iv: "d09cc5d218b24ffa0ba1932dcf8c3135"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.532176 18593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:51.551383 18593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:51.553390 18593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:51.553486 18593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:51.557348 18593 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41411
I20260808 14:42:51.557381 18690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41411 every 8 connection(s)
I20260808 14:42:51.557766 18593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:51.558159 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 18593
I20260808 14:42:51.558251 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:42:51.558457 30371 external_mini_cluster.cc:1428] Setting key db9e4ff407894160f93170e1c6417ee5
I20260808 14:42:51.558919 18691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:51.561475 18691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap starting.
I20260808 14:42:51.562045 18691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:51.562348 18691 log.cc:824] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:51.562987 18691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: No bootstrap required, opened a new log
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:51.565150 18691 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:51.565312 18691 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:51.565339 18691 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c1e17e178540e0953b14429bc4ff0e, State: Initialized, Role: FOLLOWER
I20260808 14:42:51.565490 18691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:51.565595 18691 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:42:51.565639 18691 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:42:51.565690 18691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:51.566193 18691 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:51.566275 18691 leader_election.cc:302] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34c1e17e178540e0953b14429bc4ff0e; no voters:
I20260808 14:42:51.566489 18691 leader_election.cc:288] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:42:51.566533 18700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:42:51.566651 18700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 LEADER]: Becoming Leader. State: Replica: 34c1e17e178540e0953b14429bc4ff0e, State: Running, Role: LEADER
I20260808 14:42:51.566776 18691 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:51.566785 18700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:51.567124 18700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34c1e17e178540e0953b14429bc4ff0e. Latest consensus state: current_term: 1 leader_uuid: "34c1e17e178540e0953b14429bc4ff0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } } }
I20260808 14:42:51.567137 18701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34c1e17e178540e0953b14429bc4ff0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } } }
I20260808 14:42:51.567271 18700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:51.567346 18701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: This master's current role is: LEADER
W20260808 14:42:51.568560 18721 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:42:51.568662 18721 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:42:51.568730 18713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:51.568928 18713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:51.569342 18697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:51.558957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.29.168.254:41411)
0808 14:42:51.559155 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:51.559165 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:51.559203 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:42:51.559690 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:51.559698 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:51.559752 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:51.559889 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:51.560479 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.561329 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.562138 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.562575 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.562696 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:51.565240 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:51.565244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:51.565244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:51.565254 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:51.567313 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:51.567758 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:51.567760 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:51.567760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:51.567882 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:51.568075 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:51.568076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:51.568076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:51.568378 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:51.568525 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:51.569036 (+ 511us) server_negotiation.cc:299] Negotiation successful
0808 14:42:51.569164 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":102,"threads_started":1}
I20260808 14:42:51.570407 18713 catalog_manager.cc:1347] Generated new cluster ID: 6f3a02138e774b2f81731d538ce148a8
I20260808 14:42:51.570472 18713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:42:51.578426 18713 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:42:51.578948 18713 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:42:51.589674 18713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Generated new TSK 0
I20260808 14:42:51.589816 18713 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:42:51.618541 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41411
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:51.727943 18731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:51.728166 18731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:51.728206 18731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:51.729348 18731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:51.729421 18731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:51.729462 18731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:42:51.730888 18731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:51.731144 18731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:51.731350 18731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:51.736052 18741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:51.736060 18736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:51.736083 18738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:51.736117 18731 server_base.cc:1034] running on GCE node
I20260808 14:42:51.736409 18731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:51.736670 18731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:51.737828 18731 hybrid_clock.cc:648] HybridClock initialized: now 1786200171737805 us; error 34 us; skew 500 ppm
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:51.740229 18731 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:42:51.740751 18731 webserver.cc:460] Webserver started at http://127.29.168.193:39695/ using document root <none> and password file <none>
I20260808 14:42:51.740973 18731 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:51.741032 18731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:51.741163 18731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:51.742024 18731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "a683998df2ee45ddb0a6fe9ccbea6a76"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "6c259f2e55db3bd841219ffde5e8b0f6"
server_key_iv: "b014f2fc230ebee706cbc36fe77bade7"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.742372 18731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "a683998df2ee45ddb0a6fe9ccbea6a76"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "6c259f2e55db3bd841219ffde5e8b0f6"
server_key_iv: "b014f2fc230ebee706cbc36fe77bade7"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.743664 18731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:42:51.744443 18752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.744637 18731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:51.744735 18731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "a683998df2ee45ddb0a6fe9ccbea6a76"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "6c259f2e55db3bd841219ffde5e8b0f6"
server_key_iv: "b014f2fc230ebee706cbc36fe77bade7"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.744822 18731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:51.756160 18731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:51.758271 18731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:51.758422 18731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:51.758638 18731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:51.758924 18731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:51.758987 18731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.759025 18731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:51.759053 18731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.765004 18731 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:33637
I20260808 14:42:51.765040 18916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:33637 every 8 connection(s)
I20260808 14:42:51.765338 18731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:51.773916 18697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:51.766132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:48307 (local address 127.29.168.254:41411)
0808 14:42:51.766194 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:51.766196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:51.766372 (+ 176us) server_negotiation.cc:407] Connection header received
0808 14:42:51.766817 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:51.766818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:51.766827 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:51.766881 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:51.767971 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.768463 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.769344 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.769546 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.769593 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:51.771679 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:51.771681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:51.771681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:51.771694 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:51.772805 (+ 1111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:51.773143 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:51.773144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:51.773145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:51.773191 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:51.773387 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:51.773388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:51.773388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:51.773483 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:51.773530 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:51.773746 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:42:51.773808 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:42:51.773988 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:51.766078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:48307)
0808 14:42:51.766235 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:51.766291 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:51.766739 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:51.766926 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:51.766929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:51.767612 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:51.767894 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:51.767899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.768546 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.768547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:51.769277 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:51.769279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.769616 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.769617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:51.769707 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:51.770183 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:51.770210 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:51.771552 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:51.772878 (+ 1326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:51.772884 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:51.772885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:51.773081 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:51.773247 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:51.773248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:51.773248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:51.773337 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:51.773545 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:51.773549 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:51.773645 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 14:42:51.773721 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:42:51.773822 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260808 14:42:51.774055 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 18731
I20260808 14:42:51.774159 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:42:51.774358 30371 external_mini_cluster.cc:1428] Setting key 460fb5047ff111f26b0bb5d7cfc29adc
I20260808 14:42:51.774538 18918 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41411
I20260808 14:42:51.774682 18918 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:51.774842 18918 heartbeater.cc:511] Master 127.29.168.254:41411 requested a full tablet report, sending...
I20260808 14:42:51.775346 18638 ts_manager.cc:194] Registered new tserver with Master: a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637)
I20260808 14:42:51.776016 18638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:48307
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:42:51.798497 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41411
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:51.879014 18923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:51.879179 18923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:51.879199 18923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:51.880396 18923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:51.880436 18923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:51.880509 18923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:42:51.881937 18923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:51.882176 18923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:51.882395 18923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:51.887032 18929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:51.887137 18923 server_base.cc:1034] running on GCE node
W20260808 14:42:51.887046 18934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:51.887084 18928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:51.887432 18923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:51.887739 18923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:51.888896 18923 hybrid_clock.cc:648] HybridClock initialized: now 1786200171888870 us; error 45 us; skew 500 ppm
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:51.891240 18923 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:42:51.891734 18923 webserver.cc:460] Webserver started at http://127.29.168.194:44261/ using document root <none> and password file <none>
I20260808 14:42:51.891990 18923 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:51.892055 18923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:51.892201 18923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:51.893153 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "47ee3179df93431e978cc7053fc07364"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "fbe174917365088b06f4cd896537e49c"
server_key_iv: "aac88b88d0267fa0270aa4e67d7e92ae"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.893486 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "47ee3179df93431e978cc7053fc07364"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "fbe174917365088b06f4cd896537e49c"
server_key_iv: "aac88b88d0267fa0270aa4e67d7e92ae"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.894723 18923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:42:51.895393 18942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.895577 18923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:42:51.895702 18923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "47ee3179df93431e978cc7053fc07364"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "fbe174917365088b06f4cd896537e49c"
server_key_iv: "aac88b88d0267fa0270aa4e67d7e92ae"
server_key_version: "encryptionkey@0"
I20260808 14:42:51.895808 18923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:51.908526 18923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:51.910679 18923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:51.910826 18923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:51.911036 18923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:51.911315 18923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:51.911365 18923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.911393 18923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:51.911419 18923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:51.917438 18923 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38857
I20260808 14:42:51.917471 19102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38857 every 8 connection(s)
I20260808 14:42:51.917779 18923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:42:51.923026 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 18923
I20260808 14:42:51.923131 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
Aug 08 14:42:51 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200171, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:51.923319 30371 external_mini_cluster.cc:1428] Setting key d1cb5ebb594f22a12cdee7a34f1dceb6
I20260808 14:42:51.926841 18697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:51.918474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:59103 (local address 127.29.168.254:41411)
0808 14:42:51.918559 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:51.918561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:51.918752 (+ 191us) server_negotiation.cc:407] Connection header received
0808 14:42:51.919161 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:51.919161 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:51.919171 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:51.919225 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:51.920122 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.920565 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.921460 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.921640 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.921690 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:51.923875 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:51.923877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:51.923877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:51.923883 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:51.925472 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:51.925852 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:51.925853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:51.925854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:51.925916 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:51.926209 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:51.926210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:51.926210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:51.926321 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:51.926374 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:51.926714 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:42:51.926778 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:42:51.927104 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:51.918414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:59103)
0808 14:42:51.918625 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:51.918662 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:51.919081 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:51.919297 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:51.919300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:51.919884 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:51.920047 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:51.920051 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.920645 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.920645 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:51.921368 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:51.921369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:51.921724 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:51.921725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:51.921840 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:51.922225 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:51.922232 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:51.923795 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:51.925555 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:51.925561 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:51.925563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:51.925783 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:51.925987 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:51.925988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:51.925988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:51.926132 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:51.926387 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:51.926393 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:51.926576 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 14:42:51.926695 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 14:42:51.926862 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":96,"threads_started":1}
I20260808 14:42:51.927604 19103 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41411
I20260808 14:42:51.927731 19103 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:51.927908 19103 heartbeater.cc:511] Master 127.29.168.254:41411 requested a full tablet report, sending...
I20260808 14:42:51.928270 18638 ts_manager.cc:194] Registered new tserver with Master: 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
I20260808 14:42:51.928622 18638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:59103
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:42:51.949548 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41411
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:52.027931 19111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:52.028113 19111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:52.028134 19111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:52.029137 19111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:52.029170 19111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:52.029193 19111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:42:52.030550 19111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:52.030750 19111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:52.030910 19111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:52.035607 19119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.035614 19124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.035686 19111 server_base.cc:1034] running on GCE node
W20260808 14:42:52.035621 19118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.035985 19111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:52.036180 19111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:52.037338 19111 hybrid_clock.cc:648] HybridClock initialized: now 1786200172037321 us; error 28 us; skew 500 ppm
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:52.039716 19111 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:42:52.040102 19111 webserver.cc:460] Webserver started at http://127.29.168.195:38755/ using document root <none> and password file <none>
I20260808 14:42:52.040341 19111 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:52.040423 19111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:52.040536 19111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:42:52.041394 19111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "a6651948c61f438999e61d22c33787e6"
format_stamp: "Formatted at 2026-08-08 14:42:52 on dist-test-slave-mjjr"
server_key: "c96583cabc742142e112d57fabff66f0"
server_key_iv: "007b9b4658c13172d0f790eb73f47e19"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.041694 19111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "a6651948c61f438999e61d22c33787e6"
format_stamp: "Formatted at 2026-08-08 14:42:52 on dist-test-slave-mjjr"
server_key: "c96583cabc742142e112d57fabff66f0"
server_key_iv: "007b9b4658c13172d0f790eb73f47e19"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.042900 19111 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:42:52.043613 19138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.043810 19111 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:42:52.043906 19111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "a6651948c61f438999e61d22c33787e6"
format_stamp: "Formatted at 2026-08-08 14:42:52 on dist-test-slave-mjjr"
server_key: "c96583cabc742142e112d57fabff66f0"
server_key_iv: "007b9b4658c13172d0f790eb73f47e19"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.043985 19111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:52.061250 19111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:52.062844 19111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:52.063000 19111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:52.063202 19111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:52.063530 19111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:52.063563 19111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.063582 19111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:52.063633 19111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.069824 19111 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45109
I20260808 14:42:52.069873 19314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45109 every 8 connection(s)
I20260808 14:42:52.070166 19111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:42:52.073904 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 19111
I20260808 14:42:52.073983 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:42:52.074162 30371 external_mini_cluster.cc:1428] Setting key e34fa9e0965e0b68cb38ff5581d54cda
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:52.078619 18697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.070801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:55853 (local address 127.29.168.254:41411)
0808 14:42:52.070846 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.070849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.071063 (+ 214us) server_negotiation.cc:407] Connection header received
0808 14:42:52.071472 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.071473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.071483 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.071525 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:52.072409 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.072871 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.073791 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.074097 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.074166 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.076270 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:52.076271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:52.076271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:52.076277 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:52.077442 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.077804 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.077805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.077805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.077851 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.078110 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.078111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.078111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.078226 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:52.078281 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.078499 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.078557 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:42:52.078774 19319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.070790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:55853)
0808 14:42:52.070953 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.070984 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.071379 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.071590 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.071593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.072168 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:52.072337 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.072341 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.072951 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.072952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.073680 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.073682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.074173 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.074173 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.074301 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.074819 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:52.074828 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:52.076191 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:52.077511 (+ 1320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.077517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.077519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.077743 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.077908 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.077908 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.077909 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.078036 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.078285 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:52.078289 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:52.078388 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.078468 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.078573 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260808 14:42:52.079200 19317 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41411
I20260808 14:42:52.079303 19317 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:52.079490 19317 heartbeater.cc:511] Master 127.29.168.254:41411 requested a full tablet report, sending...
I20260808 14:42:52.079857 18638 ts_manager.cc:194] Registered new tserver with Master: a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109)
I20260808 14:42:52.080178 18638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:55853
I20260808 14:42:52.085700 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:42:52.092643 18697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.086995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51974 (local address 127.29.168.254:41411)
0808 14:42:52.087063 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.087065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.087165 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:42:52.087239 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.087240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.087250 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.087316 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:52.087927 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.088380 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.089103 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.089282 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.089364 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.090440 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:52.090442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:52.090442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:52.090457 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:52.091537 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.091876 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.091877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.091877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.091930 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.092136 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.092137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.092138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.092267 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:52.092374 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.092490 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.092557 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:42:52.094040 18638 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51974:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:42:52.095574 18638 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:42:52.102078 19333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.097774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45109 (local address 127.0.0.1:53534)
0808 14:42:52.097961 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.098013 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.098074 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.098490 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.098493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.098495 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.098553 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.098554 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.099787 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.099788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.100914 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.100916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.101808 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.101887 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.101902 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.101971 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.102021 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":11,"thread_start_us":56,"threads_started":1}
I20260808 14:42:52.102192 19337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.097982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38857 (local address 127.0.0.1:44512)
0808 14:42:52.098351 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.098358 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.098436 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.098698 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.098699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.098701 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.098734 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.098736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.099983 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.099984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.101056 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.101058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.101902 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.101963 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.101968 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.102024 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.102068 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":94,"threads_started":1}
I20260808 14:42:52.102324 19331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.097821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:33637 (local address 127.0.0.1:58762)
0808 14:42:52.098301 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.098311 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.098361 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.099032 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.099033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.099035 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.099088 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.099090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.100222 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.100223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.101248 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.101250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.102109 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.102109 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.102172 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.102176 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.102229 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.102271 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":68,"threads_started":1}
I20260808 14:42:52.102421 19339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.098124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.29.168.195:45109)
0808 14:42:52.098275 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.098280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.098291 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:42:52.098327 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.098329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.098344 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.098431 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.098620 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.099691 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.100996 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.101717 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101791 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.101844 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.102300 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.102341 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260808 14:42:52.102505 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.098121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44512 (local address 127.29.168.194:38857)
0808 14:42:52.098312 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.098315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.098427 (+ 112us) server_negotiation.cc:407] Connection header received
0808 14:42:52.098536 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.098539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.098554 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.098625 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.098796 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.099886 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101154 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.101810 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101900 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.101945 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.102037 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.102074 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":85,"threads_started":1}
I20260808 14:42:52.102579 19335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.097941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58762 (local address 127.29.168.193:33637)
0808 14:42:52.098867 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.098870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.098877 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:52.098907 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.098909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.098931 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.099033 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.099144 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.100112 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101335 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.101845 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.101915 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.101967 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.102423 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.102488 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":896,"thread_start_us":81,"threads_started":1}
I20260808 14:42:52.103061 19217 tablet_service.cc:1467] Processing CreateTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 (DEFAULT_TABLE table=test-table [id=190a8bf249084be2bdb712e4e2e6d0a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:52.103132 19012 tablet_service.cc:1467] Processing CreateTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 (DEFAULT_TABLE table=test-table [id=190a8bf249084be2bdb712e4e2e6d0a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:52.103400 19012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f1b51cb08f4f1d91dc119b0a251573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:52.103400 19217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f1b51cb08f4f1d91dc119b0a251573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:52.106770 19343 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Bootstrap starting.
I20260808 14:42:52.106849 19342 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Bootstrap starting.
I20260808 14:42:52.107158 18819 tablet_service.cc:1467] Processing CreateTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 (DEFAULT_TABLE table=test-table [id=190a8bf249084be2bdb712e4e2e6d0a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:52.107478 18819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f1b51cb08f4f1d91dc119b0a251573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:52.107522 19343 tablet_bootstrap.cc:654] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:52.107522 19342 tablet_bootstrap.cc:654] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:52.108148 19342 log.cc:824] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.108148 19343 log.cc:824] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.108927 19343 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: No bootstrap required, opened a new log
I20260808 14:42:52.108996 19343 ts_tablet_manager.cc:1397] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:42:52.109246 19342 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: No bootstrap required, opened a new log
I20260808 14:42:52.109344 19342 ts_tablet_manager.cc:1397] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:42:52.110354 19347 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap starting.
I20260808 14:42:52.110881 19347 tablet_bootstrap.cc:654] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:52.111055 19343 raft_consensus.cc:348] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.111223 19343 raft_consensus.cc:374] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:52.111270 19343 raft_consensus.cc:729] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ee3179df93431e978cc7053fc07364, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.111199 19342 raft_consensus.cc:348] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.111323 19342 raft_consensus.cc:374] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:52.111364 19342 raft_consensus.cc:729] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6651948c61f438999e61d22c33787e6, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.111416 19347 log.cc:824] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.111397 19343 consensus_queue.cc:260] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.111467 19342 consensus_queue.cc:260] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.111721 19343 ts_tablet_manager.cc:1428] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:42:52.111757 19342 ts_tablet_manager.cc:1428] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:42:52.111814 19317 heartbeater.cc:503] Master 127.29.168.254:41411 was elected leader, sending a full tablet report...
I20260808 14:42:52.111840 19103 heartbeater.cc:503] Master 127.29.168.254:41411 was elected leader, sending a full tablet report...
I20260808 14:42:52.112278 19347 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: No bootstrap required, opened a new log
I20260808 14:42:52.112327 19347 ts_tablet_manager.cc:1397] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:42:52.113920 19347 raft_consensus.cc:348] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.114044 19347 raft_consensus.cc:374] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:52.114065 19347 raft_consensus.cc:729] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a683998df2ee45ddb0a6fe9ccbea6a76, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.114204 19347 consensus_queue.cc:260] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.114482 19347 ts_tablet_manager.cc:1428] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:42:52.114511 18918 heartbeater.cc:503] Master 127.29.168.254:41411 was elected leader, sending a full tablet report...
I20260808 14:42:52.161985 19350 raft_consensus.cc:482] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:52.162128 19350 raft_consensus.cc:504] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.162495 19350 leader_election.cc:288] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857), a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637)
I20260808 14:42:52.165225 19335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.162750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:50185 (local address 127.29.168.193:33637)
0808 14:42:52.162799 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.162801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.162809 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:42:52.162877 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.162878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.162887 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.162968 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.163121 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.163587 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.164488 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.164883 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.164969 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.164979 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.165125 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.165158 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:42:52.165226 19319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.162678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:33637 (local address 127.29.168.195:50185)
0808 14:42:52.162748 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.162761 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.162819 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.162974 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.162975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.162976 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.163051 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.163053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.163701 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.163702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.164388 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.164390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.164966 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.164967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.165050 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.165053 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.165120 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.165158 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 14:42:52.165376 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.162774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:59253 (local address 127.29.168.194:38857)
0808 14:42:52.162817 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.162819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.162941 (+ 122us) server_negotiation.cc:407] Connection header received
0808 14:42:52.163000 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.163001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.163010 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.163077 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.163232 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.163733 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.164656 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.165042 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.165125 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.165133 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.165279 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.165313 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:42:52.165395 19354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.162678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38857 (local address 127.29.168.195:59253)
0808 14:42:52.162867 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.162875 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.162950 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.163083 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.163084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.163085 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.163157 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.163158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.163805 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.163807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.164532 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.164534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.165124 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.165126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.165204 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.165207 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.165273 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.165310 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":12,"thread_start_us":100,"threads_started":1}
I20260808 14:42:52.165575 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f1b51cb08f4f1d91dc119b0a251573" candidate_uuid: "a6651948c61f438999e61d22c33787e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" is_pre_election: true
I20260808 14:42:52.165742 18857 raft_consensus.cc:2454] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6651948c61f438999e61d22c33787e6 in term 0.
I20260808 14:42:52.165848 19040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f1b51cb08f4f1d91dc119b0a251573" candidate_uuid: "a6651948c61f438999e61d22c33787e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ee3179df93431e978cc7053fc07364" is_pre_election: true
I20260808 14:42:52.166008 19040 raft_consensus.cc:2454] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6651948c61f438999e61d22c33787e6 in term 0.
I20260808 14:42:52.166023 19140 leader_election.cc:302] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6651948c61f438999e61d22c33787e6, a683998df2ee45ddb0a6fe9ccbea6a76; no voters:
I20260808 14:42:52.166162 19350 raft_consensus.cc:2781] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:42:52.166206 19350 raft_consensus.cc:482] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:42:52.166239 19350 raft_consensus.cc:3037] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:52.166925 19350 raft_consensus.cc:504] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.167155 19350 leader_election.cc:288] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [CANDIDATE]: Term 1 election: Requested vote from peers 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857), a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637)
I20260808 14:42:52.167227 19040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f1b51cb08f4f1d91dc119b0a251573" candidate_uuid: "a6651948c61f438999e61d22c33787e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ee3179df93431e978cc7053fc07364"
I20260808 14:42:52.167305 19040 raft_consensus.cc:3037] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:52.167346 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f1b51cb08f4f1d91dc119b0a251573" candidate_uuid: "a6651948c61f438999e61d22c33787e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76"
I20260808 14:42:52.167456 18857 raft_consensus.cc:3037] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:52.168057 19040 raft_consensus.cc:2454] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6651948c61f438999e61d22c33787e6 in term 1.
I20260808 14:42:52.168242 19145 leader_election.cc:302] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ee3179df93431e978cc7053fc07364, a6651948c61f438999e61d22c33787e6; no voters:
I20260808 14:42:52.168314 18857 raft_consensus.cc:2454] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6651948c61f438999e61d22c33787e6 in term 1.
I20260808 14:42:52.168403 19350 raft_consensus.cc:2781] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Leader election won for term 1
W20260808 14:42:52.168438 19104 tablet.cc:2369] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:42:52.168644 19350 raft_consensus.cc:686] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 1 LEADER]: Becoming Leader. State: Replica: a6651948c61f438999e61d22c33787e6, State: Running, Role: LEADER
I20260808 14:42:52.168740 19350 consensus_queue.cc:237] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.169483 18638 catalog_manager.cc:5495] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6651948c61f438999e61d22c33787e6 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "a6651948c61f438999e61d22c33787e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } health_report { overall_health: UNKNOWN } } }
I20260808 14:42:52.192231 19339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.190161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53548 (local address 127.29.168.195:45109)
0808 14:42:52.190224 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.190226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.190232 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:42:52.190257 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.190258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.190271 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.190329 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:42:52.190458 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.190859 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.191541 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.191766 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.191817 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.191961 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:42:52.192044 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:42:52.192113 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.192150 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.192164 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:42:52.193859 18857 raft_consensus.cc:1261] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Refusing update from remote peer a6651948c61f438999e61d22c33787e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:52.193859 19040 raft_consensus.cc:1261] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Refusing update from remote peer a6651948c61f438999e61d22c33787e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:52.194224 19350 consensus_queue.cc:1035] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:52.194357 19356 consensus_queue.cc:1035] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:52.196605 19363 mvcc.cc:205] Tried to move back new op lower bound from 7316275905303564288 to 7316275905203703808. Current Snapshot: MvccSnapshot[applied={T|T < 7316275905303564288}]
I20260808 14:42:52.196672 19365 mvcc.cc:205] Tried to move back new op lower bound from 7316275905303564288 to 7316275905203703808. Current Snapshot: MvccSnapshot[applied={T|T < 7316275905303564288}]
I20260808 14:42:52.196774 19364 mvcc.cc:205] Tried to move back new op lower bound from 7316275905303564288 to 7316275905203703808. Current Snapshot: MvccSnapshot[applied={T|T < 7316275905303564288}]
I20260808 14:42:52.198597 18637 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51974:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:42:52.198679 18637 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51974:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:42:52.199410 18637 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Sending DeleteTablet for 3 replicas of tablet 20f1b51cb08f4f1d91dc119b0a251573
I20260808 14:42:52.199760 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 18731
I20260808 14:42:52.199756 18819 tablet_service.cc:1514] Processing DeleteTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:58762
I20260808 14:42:52.200243 19012 tablet_service.cc:1514] Processing DeleteTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:44512
I20260808 14:42:52.207753 19217 tablet_service.cc:1514] Processing DeleteTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:53534
I20260808 14:42:52.208000 19379 tablet_replica.cc:330] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: stopping tablet replica
I20260808 14:42:52.208109 19379 raft_consensus.cc:2229] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:42:52.208113 19378 tablet_replica.cc:330] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: stopping tablet replica
I20260808 14:42:52.208218 19379 raft_consensus.cc:2258] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:52.208321 19378 raft_consensus.cc:2229] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:42:52.208467 19378 raft_consensus.cc:2258] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:52.208997 19379 ts_tablet_manager.cc:1905] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:52.209000 19378 ts_tablet_manager.cc:1905] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:52.210677 19379 ts_tablet_manager.cc:1918] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:52.210803 19379 log.cc:1196] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/20f1b51cb08f4f1d91dc119b0a251573
I20260808 14:42:52.210875 19378 ts_tablet_manager.cc:1918] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:52.210980 19378 log.cc:1196] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/20f1b51cb08f4f1d91dc119b0a251573
I20260808 14:42:52.211285 19378 ts_tablet_manager.cc:1939] T 20f1b51cb08f4f1d91dc119b0a251573 P 47ee3179df93431e978cc7053fc07364: Deleting consensus metadata
I20260808 14:42:52.211292 19379 ts_tablet_manager.cc:1939] T 20f1b51cb08f4f1d91dc119b0a251573 P a6651948c61f438999e61d22c33787e6: Deleting consensus metadata
W20260808 14:42:52.211645 18616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:33637 (error 108)
I20260808 14:42:52.211796 18621 catalog_manager.cc:4841] TS 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857): tablet 20f1b51cb08f4f1d91dc119b0a251573 (table test-table [id=190a8bf249084be2bdb712e4e2e6d0a4]) successfully deleted
I20260808 14:42:52.211894 18621 catalog_manager.cc:4841] TS a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109): tablet 20f1b51cb08f4f1d91dc119b0a251573 (table test-table [id=190a8bf249084be2bdb712e4e2e6d0a4]) successfully deleted
I20260808 14:42:52.212325 19333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.212188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:33637 (local address 127.0.0.1:58772)
0808 14:42:52.212254 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.212294 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:33637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 14:42:52.212328 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 18923
W20260808 14:42:52.212462 18616 catalog_manager.cc:4584] TS a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 20f1b51cb08f4f1d91dc119b0a251573: Network error: Client connection negotiation failed: client connection to 127.29.168.193:33637: connect: Connection refused (error 111)
I20260808 14:42:52.226387 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 19111
I20260808 14:42:52.236394 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 18593
I20260808 14:42:52.244179 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41411
--webserver_interface=127.29.168.254
--webserver_port=44987
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:52.323448 19381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:52.323715 19381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:52.323756 19381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:52.325516 19381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:52.325567 19381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:52.325585 19381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:52.325603 19381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:52.325619 19381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:52.327693 19381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=44987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:52.327940 19381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:52.328154 19381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:52.338847 19396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.338852 19391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.338898 19393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.339123 19381 server_base.cc:1034] running on GCE node
I20260808 14:42:52.339354 19381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:52.339711 19381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:52.340869 19381 hybrid_clock.cc:648] HybridClock initialized: now 1786200172340845 us; error 34 us; skew 500 ppm
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:52.343173 19381 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:52.343703 19381 webserver.cc:460] Webserver started at http://127.29.168.254:44987/ using document root <none> and password file <none>
I20260808 14:42:52.343930 19381 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:52.344017 19381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:52.345490 19381 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:42:52.346171 19408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.346366 19381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:42:52.346460 19381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "34c1e17e178540e0953b14429bc4ff0e"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "f1b465de2da36b4ad31b5acbec6b54cf"
server_key_iv: "d09cc5d218b24ffa0ba1932dcf8c3135"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.346866 19381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:52.356487 19381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:52.358078 19381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:52.358217 19381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:52.362304 19381 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41411
I20260808 14:42:52.362346 19486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41411 every 8 connection(s)
I20260808 14:42:52.362735 19381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:52.364323 19491 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:42:52.365023 19491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap starting.
I20260808 14:42:52.370898 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 19381
I20260808 14:42:52.371162 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:33637
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:41411
--webserver_port=39695
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:52.374222 19491 log.cc:824] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.376139 19491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:42:52.376406 19491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap complete.
I20260808 14:42:52.378582 19491 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.378813 19491 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c1e17e178540e0953b14429bc4ff0e, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.378974 19491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.379045 19491 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:42:52.379096 19491 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:42:52.379142 19491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:42:52.380100 19491 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.380209 19491 leader_election.cc:302] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34c1e17e178540e0953b14429bc4ff0e; no voters:
I20260808 14:42:52.380388 19491 leader_election.cc:288] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:42:52.380420 19498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:42:52.380528 19498 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 LEADER]: Becoming Leader. State: Replica: 34c1e17e178540e0953b14429bc4ff0e, State: Running, Role: LEADER
I20260808 14:42:52.380620 19498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.380648 19491 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:52.380870 19501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34c1e17e178540e0953b14429bc4ff0e. Latest consensus state: current_term: 2 leader_uuid: "34c1e17e178540e0953b14429bc4ff0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } } }
I20260808 14:42:52.381111 19501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:52.381031 19500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "34c1e17e178540e0953b14429bc4ff0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } } }
I20260808 14:42:52.381381 19500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:52.381434 19517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:52.382328 19517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:52.382434 19517 catalog_manager.cc:1259] Loaded cluster ID: 6f3a02138e774b2f81731d538ce148a8
I20260808 14:42:52.382475 19517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:42:52.382707 19517 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 14:42:52.387574 19517 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 14:42:52.389948 19517 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:42:52.390141 19517 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Loaded TSK: 0
I20260808 14:42:52.390349 19517 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:42:52.455971 19495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:52.456173 19495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:52.456208 19495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:52.457293 19495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:52.457356 19495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:52.457397 19495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:42:52.458770 19495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:33637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=39695
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:52.459002 19495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:52.459221 19495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:52.464951 19542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.464978 19543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.465334 19495 server_base.cc:1034] running on GCE node
W20260808 14:42:52.465407 19546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.465574 19495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:52.465830 19495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:52.466998 19495 hybrid_clock.cc:648] HybridClock initialized: now 1786200172466973 us; error 43 us; skew 500 ppm
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:52.469444 19495 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:42:52.469956 19495 webserver.cc:460] Webserver started at http://127.29.168.193:39695/ using document root <none> and password file <none>
I20260808 14:42:52.470213 19495 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:52.470268 19495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:52.471599 19495 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:52.472378 19561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.472566 19495 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:52.472663 19495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "a683998df2ee45ddb0a6fe9ccbea6a76"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "6c259f2e55db3bd841219ffde5e8b0f6"
server_key_iv: "b014f2fc230ebee706cbc36fe77bade7"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.472987 19495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:52.481423 19495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:52.483736 19495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:52.483880 19495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:52.484124 19495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:52.484601 19569 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:42:52.486153 19495 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:42:52.486203 19495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:42:52.486236 19495 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:42:52.486979 19495 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:42:52.487025 19495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:42:52.487063 19569 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap starting.
I20260808 14:42:52.495011 19495 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:33637
I20260808 14:42:52.495165 19724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:33637 every 8 connection(s)
I20260808 14:42:52.495512 19495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:42:52.496975 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 19495
I20260808 14:42:52.497287 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:38857
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:41411
--webserver_port=44261
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:52.499615 19569 log.cc:824] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.502218 19569 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:42:52.502512 19569 tablet_bootstrap.cc:492] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap complete.
I20260808 14:42:52.503870 19569 ts_tablet_manager.cc:1397] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.014s
I20260808 14:42:52.505184 19569 raft_consensus.cc:348] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.505515 19569 raft_consensus.cc:729] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a683998df2ee45ddb0a6fe9ccbea6a76, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.505689 19569 consensus_queue.cc:260] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.505967 19569 ts_tablet_manager.cc:1428] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:52.511158 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.496625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:48365 (local address 127.29.168.254:41411)
0808 14:42:52.499164 (+ 2539us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.499174 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.499217 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:42:52.499362 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.499369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.499428 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.499581 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:52.500525 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.501913 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.503600 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.504292 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.504402 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.507468 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:52.507472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:52.507472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:52.507484 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:52.509352 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.509849 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.509852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.509852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.509956 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.510272 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.510273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.510273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.510535 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:52.510620 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.510932 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.511039 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2482,"thread_start_us":72,"threads_started":1}
I20260808 14:42:52.511178 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.496299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:48365)
0808 14:42:52.496507 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.496549 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.497218 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.499753 (+ 2535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.499757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.500133 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:52.500378 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.500385 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.502083 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.502084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.503496 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.503499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.504525 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.504526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.504719 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.505359 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:52.505370 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:52.507341 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:52.509444 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.509452 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.509453 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.509760 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.510051 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.510052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.510052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.510193 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.510612 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:52.510618 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:52.510753 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.510854 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.511004 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":120,"threads_started":1}
I20260808 14:42:52.511968 19725 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41411
I20260808 14:42:52.512079 19725 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:52.512251 19725 heartbeater.cc:511] Master 127.29.168.254:41411 requested a full tablet report, sending...
I20260808 14:42:52.512943 19437 ts_manager.cc:194] Registered new tserver with Master: a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637)
I20260808 14:42:52.513856 19437 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:48365
I20260808 14:42:52.514576 19725 heartbeater.cc:503] Master 127.29.168.254:41411 was elected leader, sending a full tablet report...
I20260808 14:42:52.519162 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.513484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:33637 (local address 127.0.0.1:58774)
0808 14:42:52.515756 (+ 2272us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.515792 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.515854 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.516167 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.516169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.516171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.516215 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.516216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.517438 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.517439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.518150 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.518152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.518977 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.518977 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.519031 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.519039 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.519085 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.519118 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2243,"thread_start_us":82,"threads_started":1}
I20260808 14:42:52.519199 19737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.513562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.29.168.193:33637)
0808 14:42:52.516001 (+ 2439us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.516006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.516016 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:42:52.516051 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.516053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.516069 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.516153 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.516296 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.517361 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.518226 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.518894 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.518980 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.519027 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.519104 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.519138 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2404,"thread_start_us":76,"threads_started":1}
I20260808 14:42:52.519548 19627 tablet_service.cc:1514] Processing DeleteTablet for tablet 20f1b51cb08f4f1d91dc119b0a251573 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:58774
I20260808 14:42:52.520061 19738 tablet_replica.cc:330] stopping tablet replica
I20260808 14:42:52.520154 19738 raft_consensus.cc:2229] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:42:52.520208 19738 raft_consensus.cc:2258] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:52.520459 19738 ts_tablet_manager.cc:1905] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:52.522655 19738 ts_tablet_manager.cc:1918] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:52.522732 19738 log.cc:1196] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/20f1b51cb08f4f1d91dc119b0a251573
I20260808 14:42:52.522970 19738 ts_tablet_manager.cc:1939] T 20f1b51cb08f4f1d91dc119b0a251573 P a683998df2ee45ddb0a6fe9ccbea6a76: Deleting consensus metadata
I20260808 14:42:52.523471 19409 catalog_manager.cc:4841] TS a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637): tablet 20f1b51cb08f4f1d91dc119b0a251573 (table test-table [id=190a8bf249084be2bdb712e4e2e6d0a4]) successfully deleted
W20260808 14:42:52.584998 19731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:52.585213 19731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:52.585253 19731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:52.586512 19731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:52.586576 19731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:52.586621 19731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:42:52.588130 19731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:38857
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=44261
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:52.588376 19731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:52.588613 19731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:52.593402 19748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.593386 19746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.593379 19753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.593650 19731 server_base.cc:1034] running on GCE node
I20260808 14:42:52.593883 19731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:52.594152 19731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:52.595309 19731 hybrid_clock.cc:648] HybridClock initialized: now 1786200172595296 us; error 28 us; skew 500 ppm
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:52.597903 19731 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:42:52.598307 19731 webserver.cc:460] Webserver started at http://127.29.168.194:44261/ using document root <none> and password file <none>
I20260808 14:42:52.598529 19731 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:52.598611 19731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:52.599928 19731 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:52.600503 19765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.600668 19731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:42:52.600762 19731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "47ee3179df93431e978cc7053fc07364"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "fbe174917365088b06f4cd896537e49c"
server_key_iv: "aac88b88d0267fa0270aa4e67d7e92ae"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.601058 19731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:52.621004 19731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:52.622679 19731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:52.622831 19731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:52.623044 19731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:52.623334 19731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:52.623389 19731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.623436 19731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:52.623464 19731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.629556 19731 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38857
I20260808 14:42:52.629593 19930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38857 every 8 connection(s)
I20260808 14:42:52.629931 19731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:42:52.633703 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 19731
I20260808 14:42:52.633998 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:45109
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:41411
--webserver_port=38755
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:52.640259 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.630631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:51963 (local address 127.29.168.254:41411)
0808 14:42:52.630721 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.630724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.630913 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:42:52.631407 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.631408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.631425 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.631478 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:52.632480 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.632982 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.634303 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.634511 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.634576 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.637323 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:52.637325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:52.637325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:52.637332 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:52.638660 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.639209 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.639209 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.639210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.639259 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.639550 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.639551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.639551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.639706 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:52.639761 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.640121 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.640196 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:42:52.640563 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.630615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:51963)
0808 14:42:52.630787 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.630820 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.631295 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.631563 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.631566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.632127 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:52.632381 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.632386 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.633082 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.633084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.634173 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.634177 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.634602 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.634603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.634751 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.635223 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:52.635233 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:52.637233 (+ 2000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:52.638774 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.638781 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.638784 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.639121 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.639328 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.639329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.639329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.639478 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.639774 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:52.639781 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:52.639957 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.640092 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.640272 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":79,"threads_started":1}
I20260808 14:42:52.641098 19931 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41411
I20260808 14:42:52.641202 19931 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:52.641402 19931 heartbeater.cc:511] Master 127.29.168.254:41411 requested a full tablet report, sending...
I20260808 14:42:52.641776 19437 ts_manager.cc:194] Registered new tserver with Master: 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
I20260808 14:42:52.642148 19437 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:51963
W20260808 14:42:52.717942 19938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:52.718158 19938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:52.718199 19938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:52.719313 19938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:52.719375 19938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:52.719444 19938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:42:52.721004 19938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:45109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=38755
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:52.721187 19938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:52.721347 19938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:52.726087 19946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.726106 19952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.726130 19948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.726562 19938 server_base.cc:1034] running on GCE node
I20260808 14:42:52.726773 19938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:52.727005 19938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:52.728163 19938 hybrid_clock.cc:648] HybridClock initialized: now 1786200172728160 us; error 36 us; skew 500 ppm
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:52.730486 19938 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:42:52.730878 19938 webserver.cc:460] Webserver started at http://127.29.168.195:38755/ using document root <none> and password file <none>
I20260808 14:42:52.731094 19938 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:52.731175 19938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:52.732542 19938 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:52.733117 19961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.733282 19938 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:42:52.733384 19938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "a6651948c61f438999e61d22c33787e6"
format_stamp: "Formatted at 2026-08-08 14:42:52 on dist-test-slave-mjjr"
server_key: "c96583cabc742142e112d57fabff66f0"
server_key_iv: "007b9b4658c13172d0f790eb73f47e19"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.733678 19938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:52.739925 19938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:52.741493 19938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:52.741639 19938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:52.741845 19938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:52.742129 19938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:52.742183 19938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.742223 19938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:52.742250 19938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.748474 19938 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45109
I20260808 14:42:52.748519 20133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45109 every 8 connection(s)
I20260808 14:42:52.748849 19938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:42:52.750247 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 19938
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:42:52.757747 20140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.750675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51988 (local address 127.29.168.254:41411)
0808 14:42:52.751396 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.751399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.751405 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:42:52.751423 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.751424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.751435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.751520 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:52.752146 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.752600 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.753326 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.753527 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.753600 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.754797 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:52.754798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:52.754798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:52.754804 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:52.756589 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.756959 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.756960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.756961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.757024 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.757233 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.757234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.757234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.757341 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:52.757528 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.757565 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.757641 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":71,"threads_started":1}
I20260808 14:42:52.758394 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.749493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:55239 (local address 127.29.168.254:41411)
0808 14:42:52.749537 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.749539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.749796 (+ 257us) server_negotiation.cc:407] Connection header received
0808 14:42:52.750263 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.750264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.750277 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.750339 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:52.751360 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.752025 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.752984 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.753174 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.753244 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.755525 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:52.755526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:52.755527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:52.755534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:52.756874 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.757285 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.757286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.757286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.757343 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:52.757595 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:52.757596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:52.757596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:52.757723 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:52.757794 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.758229 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.758305 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:42:52.758597 20136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.749497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:55239)
0808 14:42:52.749679 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.749718 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.750160 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.750409 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.750413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.751079 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:52.751247 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.751252 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.752118 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.752119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.752856 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.752858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.753267 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.753268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.753384 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.753853 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:52.753863 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:52.755406 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:52.756979 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.756987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.756989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.757199 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.757416 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:52.757417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:52.757417 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:52.757527 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:52.757921 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:52.757928 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:52.758081 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.758193 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.758332 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260808 14:42:52.759029 20134 heartbeater.cc:347] Connected to a master server at 127.29.168.254:41411
I20260808 14:42:52.759105 20134 heartbeater.cc:464] Registering TS with master...
I20260808 14:42:52.759286 20134 heartbeater.cc:511] Master 127.29.168.254:41411 requested a full tablet report, sending...
I20260808 14:42:52.759701 19437 ts_manager.cc:194] Registered new tserver with Master: a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109)
I20260808 14:42:52.760078 19437 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:55239
I20260808 14:42:52.769270 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:42:52.771612 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.769621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51998 (local address 127.29.168.254:41411)
0808 14:42:52.769670 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.769672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.769781 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:42:52.769823 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.769824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.769850 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.769905 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:42:52.770000 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.770410 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.771049 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.771212 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.771259 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.771386 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:42:52.771466 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:42:52.771522 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.771558 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.771570 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:42:52.771876 19437 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:42:52.773348 19437 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:42:52.775382 19627 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5255ae6dad41dc8f7d284e00b86856 (DEFAULT_TABLE table=test-table [id=464e81ca18d442128b6db74e95e2a776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:52.775595 19627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5255ae6dad41dc8f7d284e00b86856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:52.777242 19569 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap starting.
I20260808 14:42:52.777592 19569 tablet_bootstrap.cc:654] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:52.778160 19569 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: No bootstrap required, opened a new log
I20260808 14:42:52.778213 19569 ts_tablet_manager.cc:1397] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:42:52.778324 19569 raft_consensus.cc:348] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.778393 19569 raft_consensus.cc:374] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:52.778422 19569 raft_consensus.cc:729] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a683998df2ee45ddb0a6fe9ccbea6a76, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.778501 19569 consensus_queue.cc:260] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.778609 19569 ts_tablet_manager.cc:1428] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.779444 20143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.775277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38857 (local address 127.0.0.1:44526)
0808 14:42:52.775551 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.775559 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.775599 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.775891 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.775892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.775894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.775933 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.775935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.777280 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.777281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.778280 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.778283 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.779192 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.779193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.779257 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.779262 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.779318 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.779370 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":80,"threads_started":1}
I20260808 14:42:52.779470 20144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.775379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44526 (local address 127.29.168.194:38857)
0808 14:42:52.775744 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.775748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.775757 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:42:52.775795 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.775797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.775814 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.775896 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.776080 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.777154 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.778374 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.779105 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.779183 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.779242 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.779331 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.779389 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":100,"threads_started":1}
I20260808 14:42:52.779556 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.775152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45109 (local address 127.0.0.1:53552)
0808 14:42:52.775395 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.775405 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.775452 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.775676 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.775677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.775679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.775713 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.775715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.776771 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.776772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.777607 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.777610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.779313 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.779314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.779380 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.779382 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.779410 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.779441 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228}
I20260808 14:42:52.779727 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.775217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53552 (local address 127.29.168.195:45109)
0808 14:42:52.775393 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.775398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.775440 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:42:52.775526 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.775528 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.775544 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.775630 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.775779 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.776668 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.777834 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.779219 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.779503 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.779568 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.779593 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.779655 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":82,"threads_started":1}
I20260808 14:42:52.780133 19835 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5255ae6dad41dc8f7d284e00b86856 (DEFAULT_TABLE table=test-table [id=464e81ca18d442128b6db74e95e2a776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:52.780371 20039 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5255ae6dad41dc8f7d284e00b86856 (DEFAULT_TABLE table=test-table [id=464e81ca18d442128b6db74e95e2a776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:42:52.780536 19835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5255ae6dad41dc8f7d284e00b86856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:52.780709 20039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5255ae6dad41dc8f7d284e00b86856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:42:52.783179 20148 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Bootstrap starting.
I20260808 14:42:52.783468 20149 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Bootstrap starting.
I20260808 14:42:52.783944 20148 tablet_bootstrap.cc:654] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:52.784157 20149 tablet_bootstrap.cc:654] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:42:52.784592 20148 log.cc:824] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.784737 20149 log.cc:824] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.785477 20149 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: No bootstrap required, opened a new log
I20260808 14:42:52.785486 20148 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: No bootstrap required, opened a new log
I20260808 14:42:52.785553 20148 ts_tablet_manager.cc:1397] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:42:52.785553 20149 ts_tablet_manager.cc:1397] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:42:52.786582 19734 raft_consensus.cc:482] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:52.786676 19734 raft_consensus.cc:504] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.786962 19734 leader_election.cc:288] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109), 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
I20260808 14:42:52.787999 20148 raft_consensus.cc:348] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.788156 20148 raft_consensus.cc:374] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:52.788084 20149 raft_consensus.cc:348] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.788188 20148 raft_consensus.cc:729] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ee3179df93431e978cc7053fc07364, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.788201 20149 raft_consensus.cc:374] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:42:52.788232 20149 raft_consensus.cc:729] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6651948c61f438999e61d22c33787e6, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.788321 20149 consensus_queue.cc:260] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.788321 20148 consensus_queue.cc:260] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.788601 20149 ts_tablet_manager.cc:1428] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:42:52.788712 20134 heartbeater.cc:503] Master 127.29.168.254:41411 was elected leader, sending a full tablet report...
I20260808 14:42:52.789762 20148 ts_tablet_manager.cc:1428] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 14:42:52.789894 19931 heartbeater.cc:503] Master 127.29.168.254:41411 was elected leader, sending a full tablet report...
I20260808 14:42:52.790570 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.787408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:48003 (local address 127.29.168.195:45109)
0808 14:42:52.787467 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.787469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.787477 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:42:52.787496 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.787497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.787505 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.787565 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.787794 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.788515 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.789722 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.790241 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.790301 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.790306 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.790484 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.790518 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:42:52.790596 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.787085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45109 (local address 127.29.168.193:48003)
0808 14:42:52.787124 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.787134 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.787171 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.787608 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.787610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.787611 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.787719 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.787721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.788587 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.788588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.789630 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.789633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.790315 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.790316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.790401 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.790406 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.790475 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.790514 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":3}
I20260808 14:42:52.790885 20144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.787409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:32875 (local address 127.29.168.194:38857)
0808 14:42:52.787452 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.787454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.787461 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:42:52.787479 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.787480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.787487 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.787535 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:42:52.788079 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.788762 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.789970 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.790492 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.790532 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.790544 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.790788 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.790827 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:42:52.790966 20068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5255ae6dad41dc8f7d284e00b86856" candidate_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6651948c61f438999e61d22c33787e6" is_pre_election: true
I20260808 14:42:52.791098 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.787183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38857 (local address 127.29.168.193:32875)
0808 14:42:52.787299 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.787309 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:52.787350 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:52.787553 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:52.787554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:52.787556 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:42:52.787987 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.787991 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.788875 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.788875 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.789873 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:52.789876 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.790595 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.790596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:52.790684 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.790688 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:42:52.790944 (+ 256us) client_negotiation.cc:240] Negotiation successful
0808 14:42:52.790989 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260808 14:42:52.791100 20068 raft_consensus.cc:2454] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a683998df2ee45ddb0a6fe9ccbea6a76 in term 0.
I20260808 14:42:52.791260 19564 leader_election.cc:302] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6651948c61f438999e61d22c33787e6, a683998df2ee45ddb0a6fe9ccbea6a76; no voters:
I20260808 14:42:52.791388 19734 raft_consensus.cc:2781] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:42:52.791440 19734 raft_consensus.cc:482] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:42:52.791466 19734 raft_consensus.cc:3037] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:52.791486 19867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5255ae6dad41dc8f7d284e00b86856" candidate_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ee3179df93431e978cc7053fc07364" is_pre_election: true
I20260808 14:42:52.791673 19867 raft_consensus.cc:2454] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a683998df2ee45ddb0a6fe9ccbea6a76 in term 0.
I20260808 14:42:52.792332 19734 raft_consensus.cc:504] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.792459 19734 leader_election.cc:288] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 1 election: Requested vote from peers a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109), 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
I20260808 14:42:52.792619 20068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5255ae6dad41dc8f7d284e00b86856" candidate_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6651948c61f438999e61d22c33787e6"
I20260808 14:42:52.792688 20068 raft_consensus.cc:3037] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:52.793342 20068 raft_consensus.cc:2454] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a683998df2ee45ddb0a6fe9ccbea6a76 in term 1.
I20260808 14:42:52.793503 19564 leader_election.cc:302] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6651948c61f438999e61d22c33787e6, a683998df2ee45ddb0a6fe9ccbea6a76; no voters:
I20260808 14:42:52.793542 19867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5255ae6dad41dc8f7d284e00b86856" candidate_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ee3179df93431e978cc7053fc07364"
I20260808 14:42:52.793617 19734 raft_consensus.cc:2781] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:42:52.793617 19867 raft_consensus.cc:3037] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:42:52.793764 19734 raft_consensus.cc:686] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 LEADER]: Becoming Leader. State: Replica: a683998df2ee45ddb0a6fe9ccbea6a76, State: Running, Role: LEADER
I20260808 14:42:52.793862 19734 consensus_queue.cc:237] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:52.794513 19867 raft_consensus.cc:2454] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a683998df2ee45ddb0a6fe9ccbea6a76 in term 1.
I20260808 14:42:52.794601 19437 catalog_manager.cc:5495] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } health_report { overall_health: HEALTHY } } }
I20260808 14:42:52.799448 19737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.797590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58780 (local address 127.29.168.193:33637)
0808 14:42:52.797625 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:52.797627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:52.797635 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:42:52.797712 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:52.797713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:52.797725 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:52.797780 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:42:52.797859 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.798253 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.798927 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:52.799087 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:52.799132 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:52.799240 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:42:52.799311 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:42:52.799355 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:52.799395 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:42:52.799408 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:42:52.800704 19867 raft_consensus.cc:1261] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Refusing update from remote peer a683998df2ee45ddb0a6fe9ccbea6a76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:52.800704 20068 raft_consensus.cc:1261] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Refusing update from remote peer a683998df2ee45ddb0a6fe9ccbea6a76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:42:52.801005 19734 consensus_queue.cc:1035] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:52.801149 20157 consensus_queue.cc:1035] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:42:52.804073 20163 mvcc.cc:205] Tried to move back new op lower bound from 7316275907789590528 to 7316275907764240384. Current Snapshot: MvccSnapshot[applied={T|T < 7316275907789590528 or (T in {7316275907789590528})}]
I20260808 14:42:52.805243 19433 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:42:52.805321 19433 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:42:52.805922 19433 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Sending DeleteTablet for 3 replicas of tablet 3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:42:52.806213 20039 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5255ae6dad41dc8f7d284e00b86856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:53552
I20260808 14:42:52.806236 19627 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5255ae6dad41dc8f7d284e00b86856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:58774
I20260808 14:42:52.806313 19738 tablet_replica.cc:330] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: stopping tablet replica
I20260808 14:42:52.806288 19835 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d5255ae6dad41dc8f7d284e00b86856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:42:52 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:44526
I20260808 14:42:52.806360 19738 raft_consensus.cc:2229] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:42:52.806445 19738 raft_consensus.cc:2258] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:52.806484 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 19495
I20260808 14:42:52.812263 20175 tablet_replica.cc:330] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: stopping tablet replica
I20260808 14:42:52.812377 20175 raft_consensus.cc:2229] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:42:52.812484 20175 raft_consensus.cc:2258] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:52.812608 20174 tablet_replica.cc:330] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: stopping tablet replica
I20260808 14:42:52.812677 20174 raft_consensus.cc:2229] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:42:52.812743 20174 raft_consensus.cc:2258] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:42:52.813894 20174 ts_tablet_manager.cc:1905] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:52.815757 20174 ts_tablet_manager.cc:1918] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:52.815830 20174 log.cc:1196] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:42:52.816069 20174 ts_tablet_manager.cc:1939] T 3d5255ae6dad41dc8f7d284e00b86856 P a6651948c61f438999e61d22c33787e6: Deleting consensus metadata
I20260808 14:42:52.816722 20175 ts_tablet_manager.cc:1905] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:42:52.818207 20175 ts_tablet_manager.cc:1918] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:42:52.818262 20175 log.cc:1196] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:42:52.818488 20175 ts_tablet_manager.cc:1939] T 3d5255ae6dad41dc8f7d284e00b86856 P 47ee3179df93431e978cc7053fc07364: Deleting consensus metadata
I20260808 14:42:52.818850 19411 catalog_manager.cc:4841] TS 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857): tablet 3d5255ae6dad41dc8f7d284e00b86856 (table test-table [id=464e81ca18d442128b6db74e95e2a776]) successfully deleted
I20260808 14:42:52.821641 19411 catalog_manager.cc:4841] TS a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109): tablet 3d5255ae6dad41dc8f7d284e00b86856 (table test-table [id=464e81ca18d442128b6db74e95e2a776]) successfully deleted
W20260808 14:42:52.826071 19409 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:33637 (error 108)
I20260808 14:42:52.826386 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 19731
I20260808 14:42:52.826607 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:52.826455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:33637 (local address 127.0.0.1:58794)
0808 14:42:52.826530 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:52.826571 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:33637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 14:42:52.826705 19409 catalog_manager.cc:4584] TS a683998df2ee45ddb0a6fe9ccbea6a76 (127.29.168.193:33637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3d5255ae6dad41dc8f7d284e00b86856: Network error: Client connection negotiation failed: client connection to 127.29.168.193:33637: connect: Connection refused (error 111)
I20260808 14:42:52.834266 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 19938
I20260808 14:42:52.846623 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 19381
I20260808 14:42:52.854789 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41411
--webserver_interface=127.29.168.254
--webserver_port=44987
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:52.932600 20178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:52.932828 20178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:52.932862 20178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:52.934024 20178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:42:52.934090 20178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:52.934113 20178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:52.934131 20178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:42:52.934158 20178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:42:52.935580 20178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=44987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:52.935884 20178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:52.936118 20178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:52.940737 20184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.940757 20185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:52.940773 20187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:52.940907 20178 server_base.cc:1034] running on GCE node
I20260808 14:42:52.941166 20178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:52.941421 20178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:52.942584 20178 hybrid_clock.cc:648] HybridClock initialized: now 1786200172942567 us; error 29 us; skew 500 ppm
Aug 08 14:42:52 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200172, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:52.944921 20178 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:42:52.945374 20178 webserver.cc:460] Webserver started at http://127.29.168.254:44987/ using document root <none> and password file <none>
I20260808 14:42:52.945600 20178 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:52.945672 20178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:52.947039 20178 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:52.947757 20195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:52.947933 20178 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:52.948031 20178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "34c1e17e178540e0953b14429bc4ff0e"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "f1b465de2da36b4ad31b5acbec6b54cf"
server_key_iv: "d09cc5d218b24ffa0ba1932dcf8c3135"
server_key_version: "encryptionkey@0"
I20260808 14:42:52.948362 20178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:52.956493 20178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:52.958036 20178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:52.958199 20178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:52.962277 20178 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41411
I20260808 14:42:52.962306 20274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41411 every 8 connection(s)
I20260808 14:42:52.962656 20178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:42:52.964133 20275 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:42:52.964712 20275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap starting.
I20260808 14:42:52.969841 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 20178
I20260808 14:42:52.970192 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:33637
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:41411
--webserver_port=39695
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:52.974308 20275 log.cc:824] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:52.976559 20275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:42:52.976869 20275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e: Bootstrap complete.
I20260808 14:42:52.979068 20275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.979274 20275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c1e17e178540e0953b14429bc4ff0e, State: Initialized, Role: FOLLOWER
I20260808 14:42:52.979436 20275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.979498 20275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:42:52.979559 20275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:42:52.979602 20275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:42:52.980571 20275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.980654 20275 leader_election.cc:302] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34c1e17e178540e0953b14429bc4ff0e; no voters:
I20260808 14:42:52.980826 20275 leader_election.cc:288] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:42:52.980863 20280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:42:52.980978 20280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [term 3 LEADER]: Becoming Leader. State: Replica: 34c1e17e178540e0953b14429bc4ff0e, State: Running, Role: LEADER
I20260808 14:42:52.981088 20275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:42:52.981065 20280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } }
I20260808 14:42:52.981467 20281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "34c1e17e178540e0953b14429bc4ff0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } } }
I20260808 14:42:52.981557 20281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:52.981484 20282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34c1e17e178540e0953b14429bc4ff0e. Latest consensus state: current_term: 3 leader_uuid: "34c1e17e178540e0953b14429bc4ff0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34c1e17e178540e0953b14429bc4ff0e" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41411 } } }
I20260808 14:42:52.981711 20282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34c1e17e178540e0953b14429bc4ff0e [sys.catalog]: This master's current role is: LEADER
I20260808 14:42:52.982175 20288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:42:52.982882 20288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:42:52.982990 20288 catalog_manager.cc:1259] Loaded cluster ID: 6f3a02138e774b2f81731d538ce148a8
I20260808 14:42:52.983022 20288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 14:42:52.983273 20288 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f19cfe4e9ad google::LogMessage::Fail() at ??:0
@ 0x7f19cfe5188a google::LogMessage::SendToLog() at ??:0
@ 0x7f19cfe4e4de google::LogMessage::Flush() at ??:0
@ 0x7f19cfe4fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f19d7d6f0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f19d7d788b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f19d1d1c0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f19d1d11954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f19d2b756db start_thread at ??:0
@ 0x7f19ce94c61f clone at ??:0
W20260808 14:42:53.083858 20277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:53.084115 20277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:53.084149 20277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:53.085799 20277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:53.085855 20277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:53.085896 20277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:42:53.088181 20277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:33637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=39695
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:53.088430 20277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:53.088699 20277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:53.094031 20320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:53.094103 20325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:53.094250 20322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:53.094264 20277 server_base.cc:1034] running on GCE node
I20260808 14:42:53.094527 20277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:53.094769 20277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:53.095948 20277 hybrid_clock.cc:648] HybridClock initialized: now 1786200173095927 us; error 33 us; skew 500 ppm
Aug 08 14:42:53 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200173, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:53.098989 20277 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:42:53.099434 20277 webserver.cc:460] Webserver started at http://127.29.168.193:39695/ using document root <none> and password file <none>
I20260808 14:42:53.099694 20277 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:53.099783 20277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:53.101123 20277 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:53.101830 20334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.102052 20277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:53.102156 20277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "a683998df2ee45ddb0a6fe9ccbea6a76"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "6c259f2e55db3bd841219ffde5e8b0f6"
server_key_iv: "b014f2fc230ebee706cbc36fe77bade7"
server_key_version: "encryptionkey@0"
I20260808 14:42:53.102471 20277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:53.119194 20277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:53.121452 20277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:53.121608 20277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:53.121830 20277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:53.122285 20345 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:42:53.124114 20277 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:42:53.124168 20277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:42:53.124208 20277 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:42:53.124842 20277 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:42:53.124897 20277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:42:53.124972 20345 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap starting.
I20260808 14:42:53.132346 20277 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:33637
I20260808 14:42:53.132483 20496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:33637 every 8 connection(s)
I20260808 14:42:53.132753 20277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:42:53.136251 20345 log.cc:824] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Log is configured to *not* fsync() on all Append() calls
I20260808 14:42:53.136585 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 20277
I20260808 14:42:53.136895 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:38857
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:41411
--webserver_port=44261
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:42:53.138931 20345 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:42:53.139241 20345 tablet_bootstrap.cc:492] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Bootstrap complete.
I20260808 14:42:53.140573 20345 ts_tablet_manager.cc:1397] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.006s
I20260808 14:42:53.141973 20345 raft_consensus.cc:348] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:53.142282 20345 raft_consensus.cc:729] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a683998df2ee45ddb0a6fe9ccbea6a76, State: Initialized, Role: FOLLOWER
I20260808 14:42:53.142437 20345 consensus_queue.cc:260] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:53.142710 20345 ts_tablet_manager.cc:1428] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260808 14:42:53.192211 20500 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:42:53.133409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:44107)
0808 14:42:53.133589 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.133630 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:53.134114 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:53.191998 (+ 57884us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
W20260808 14:42:53.192481 20497 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:41411 (0 consecutive failures): Network error: Failed to ping master at 127.29.168.254:41411: Client connection negotiation failed: client connection to 127.29.168.254:41411: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:42:53.192879 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.192676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:39119)
0808 14:42:53.192728 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.192836 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:42:53.193239 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.193131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:57559)
0808 14:42:53.193165 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.193198 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 14:42:53.193419 20497 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:42:53.220293 20502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:53.220484 20502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:53.220520 20502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:53.221565 20502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:53.221625 20502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:53.221666 20502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:42:53.222997 20502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:38857
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=44261
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:53.223249 20502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:53.223449 20502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:53.228384 20513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:53.228405 20502 server_base.cc:1034] running on GCE node
W20260808 14:42:53.228379 20510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:53.228379 20515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:53.228776 20502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:53.229030 20502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:53.230196 20502 hybrid_clock.cc:648] HybridClock initialized: now 1786200173230158 us; error 27 us; skew 500 ppm
Aug 08 14:42:53 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200173, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:53.232574 20502 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:42:53.232952 20502 webserver.cc:460] Webserver started at http://127.29.168.194:44261/ using document root <none> and password file <none>
I20260808 14:42:53.233166 20502 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:53.233227 20502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:53.234397 20502 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:53.235062 20527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.235250 20502 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:42:53.235348 20502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "47ee3179df93431e978cc7053fc07364"
format_stamp: "Formatted at 2026-08-08 14:42:51 on dist-test-slave-mjjr"
server_key: "fbe174917365088b06f4cd896537e49c"
server_key_iv: "aac88b88d0267fa0270aa4e67d7e92ae"
server_key_version: "encryptionkey@0"
I20260808 14:42:53.235649 20502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:53.244989 20502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:53.246783 20502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:53.246943 20502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:53.247146 20502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:53.247427 20502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:53.247489 20502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.247530 20502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:53.247560 20502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.253281 20502 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38857
I20260808 14:42:53.253348 20690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38857 every 8 connection(s)
I20260808 14:42:53.253680 20502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:42:53.254653 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.254306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:59119)
0808 14:42:53.254453 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.254524 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
W20260808 14:42:53.255046 20691 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:41411 (0 consecutive failures): Network error: Failed to ping master at 127.29.168.254:41411: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
I20260808 14:42:53.255318 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.255233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:33813)
0808 14:42:53.255276 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.255302 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:42:53.255585 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.255528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:52375)
0808 14:42:53.255552 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.255572 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 14:42:53.255713 20691 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:42:53.262615 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 20502
I20260808 14:42:53.262804 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:45109
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:41411
--webserver_port=38755
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:42:53.344472 20696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:42:53.344642 20696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:42:53.344663 20696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:42:53.345745 20696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:42:53.345778 20696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:42:53.345803 20696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:42:53.347322 20696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:45109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=38755
--tserver_master_addrs=127.29.168.254:41411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:42:53.347492 20696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:42:53.347689 20696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:42:53.352315 20702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:53.352391 20696 server_base.cc:1034] running on GCE node
W20260808 14:42:53.352322 20703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:42:53.352334 20705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:42:53.352758 20696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:42:53.352969 20696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:42:53.354127 20696 hybrid_clock.cc:648] HybridClock initialized: now 1786200173354118 us; error 35 us; skew 500 ppm
Aug 08 14:42:53 dist-test-slave-mjjr krb5kdc[18576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200173, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:42:53.356650 20696 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:42:53.357075 20696 webserver.cc:460] Webserver started at http://127.29.168.195:38755/ using document root <none> and password file <none>
I20260808 14:42:53.357283 20696 fs_manager.cc:359] Metadata directory not provided
I20260808 14:42:53.357345 20696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:42:53.358528 20696 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:42:53.359118 20717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.359280 20696 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:42:53.359369 20696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "a6651948c61f438999e61d22c33787e6"
format_stamp: "Formatted at 2026-08-08 14:42:52 on dist-test-slave-mjjr"
server_key: "c96583cabc742142e112d57fabff66f0"
server_key_iv: "007b9b4658c13172d0f790eb73f47e19"
server_key_version: "encryptionkey@0"
I20260808 14:42:53.359712 20696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:42:53.377872 20696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:42:53.380429 20696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:42:53.380604 20696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:42:53.381140 20696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:42:53.381497 20696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:42:53.381556 20696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.381618 20696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:42:53.381660 20696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:42:53.388703 20696 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:45109
I20260808 14:42:53.388736 20889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:45109 every 8 connection(s)
I20260808 14:42:53.389073 20696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:42:53.390098 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.389720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:52699)
0808 14:42:53.389882 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.389962 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
W20260808 14:42:53.390501 20890 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:41411 (0 consecutive failures): Network error: Failed to ping master at 127.29.168.254:41411: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
I20260808 14:42:53.390841 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.390706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:59799)
0808 14:42:53.390783 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.390823 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:42:53.391075 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:53.391029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:36553)
0808 14:42:53.391047 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:53.391065 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10}
W20260808 14:42:53.391198 20890 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:42:53.398459 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 20696
I20260808 14:42:54.193941 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.193731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:48635)
0808 14:42:54.193850 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:54.193880 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":57,"threads_started":1}
I20260808 14:42:54.256284 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.255989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:53505)
0808 14:42:54.256184 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:54.256217 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":51,"threads_started":1}
I20260808 14:42:54.391897 20897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.391631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:36969)
0808 14:42:54.391819 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:54.391851 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":129,"threads_started":1}
I20260808 14:42:54.550298 20898 raft_consensus.cc:482] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:54.550410 20898 raft_consensus.cc:504] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:54.550706 20898 leader_election.cc:288] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109), 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
Aug 08 14:42:54 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200173, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.194@KRBTEST.COM
Aug 08 14:42:54 dist-test-slave-mjjr krb5kdc[18576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200173, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.195@KRBTEST.COM
I20260808 14:42:54.560755 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.550842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:45109 (local address 127.29.168.193:37793)
0808 14:42:54.550883 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:54.550894 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:54.550950 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:54.551918 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:54.551922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:54.552342 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:54.552537 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:54.552543 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.553605 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.553606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:54.554316 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:54.554319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.554922 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.554923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:54.555003 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:54.555589 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:54.555597 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:54.557439 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:54.559245 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559247 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:54.559247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:54.559458 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:54.559721 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559723 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:54.559723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:54.559850 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:54.560244 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:54.560250 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:54.560374 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 14:42:54.560477 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:42:54.560656 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":62}
I20260808 14:42:54.560768 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.550942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:37793 (local address 127.29.168.195:45109)
0808 14:42:54.551076 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:54.551089 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:54.551131 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:42:54.551630 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:54.551633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:54.551730 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:54.551850 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:54.552672 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.553492 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.554429 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.554819 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.554956 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:54.557556 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:54.557559 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:54.557560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:54.557569 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:54.559114 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559540 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:54.559543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:54.559543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:54.559632 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559945 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:54.559946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:54.559946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:54.560165 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:54.560250 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:54.560544 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 14:42:54.560661 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260808 14:42:54.560804 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.551129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:39505 (local address 127.29.168.194:38857)
0808 14:42:54.551263 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:42:54.551272 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:42:54.551300 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:42:54.551777 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:42:54.551779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:42:54.551837 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:42:54.551990 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:42:54.552672 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.553488 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.554391 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.554803 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.554922 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:54.557168 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:42:54.557172 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:42:54.557172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:42:54.557189 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:42:54.558981 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559553 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:54.559555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:54.559556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:54.559684 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559945 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:42:54.559946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:42:54.559946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:42:54.560165 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:42:54.560251 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:42:54.560551 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 14:42:54.560694 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
I20260808 14:42:54.560865 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:54.550950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38857 (local address 127.29.168.193:39505)
0808 14:42:54.551028 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:54.551038 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:42:54.551074 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:42:54.551988 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:42:54.551990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:42:54.552343 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:42:54.552537 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:54.552543 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.553592 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.553593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:54.554313 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:42:54.554315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:42:54.554894 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:42:54.554896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:42:54.555002 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:42:54.555687 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:42:54.555692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:42:54.557061 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:42:54.559172 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559179 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:54.559181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:54.559445 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:54.559751 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:42:54.559751 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:42:54.559752 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:42:54.559851 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:42:54.560249 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:42:54.560256 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:42:54.560374 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 14:42:54.560487 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:42:54.560735 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":125,"thread_start_us":48,"threads_started":1}
W20260808 14:42:54.562194 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
W20260808 14:42:54.562258 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:42:54.562304 20340 leader_election.cc:302] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a683998df2ee45ddb0a6fe9ccbea6a76; no voters: 47ee3179df93431e978cc7053fc07364, a6651948c61f438999e61d22c33787e6
I20260808 14:42:54.562425 20898 raft_consensus.cc:2726] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:42:55.194782 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:55.194565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:59957)
0808 14:42:55.194695 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:55.194733 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260808 14:42:55.256855 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:55.256693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:43901)
0808 14:42:55.256795 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:55.256824 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":54,"threads_started":1}
I20260808 14:42:55.392467 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:55.392271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:57189)
0808 14:42:55.392379 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:55.392409 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260808 14:42:56.195510 20909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:56.195290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:43147)
0808 14:42:56.195423 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:56.195462 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260808 14:42:56.257401 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:56.257222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:58729)
0808 14:42:56.257335 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:56.257365 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":55,"threads_started":1}
I20260808 14:42:56.349520 20911 raft_consensus.cc:482] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:56.349633 20911 raft_consensus.cc:504] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:56.349803 20911 leader_election.cc:288] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109), 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
W20260808 14:42:56.350291 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
W20260808 14:42:56.350383 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:42:56.350427 20340 leader_election.cc:302] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a683998df2ee45ddb0a6fe9ccbea6a76; no voters: 47ee3179df93431e978cc7053fc07364, a6651948c61f438999e61d22c33787e6
I20260808 14:42:56.350518 20911 raft_consensus.cc:2726] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:42:56.393060 20912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:56.392876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:59355)
0808 14:42:56.392989 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:56.393023 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
I20260808 14:42:57.196187 20914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:57.195990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:58631)
0808 14:42:57.196105 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:57.196140 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260808 14:42:57.257964 20915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:57.257794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:41791)
0808 14:42:57.257897 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:57.257928 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":53,"threads_started":1}
I20260808 14:42:57.393677 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:57.393474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:46091)
0808 14:42:57.393618 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:57.393644 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260808 14:42:58.196929 20917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:58.196716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:45711)
0808 14:42:58.196852 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:58.196884 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260808 14:42:58.258621 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:58.258428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:46853)
0808 14:42:58.258555 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:58.258586 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260808 14:42:58.394354 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:58.394157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:58889)
0808 14:42:58.394285 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:58.394319 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":57,"threads_started":1}
I20260808 14:42:59.191087 20924 raft_consensus.cc:482] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:42:59.191180 20924 raft_consensus.cc:504] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:42:59.191298 20924 leader_election.cc:288] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109), 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
W20260808 14:42:59.191721 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
W20260808 14:42:59.191792 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:42:59.191805 20340 leader_election.cc:302] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a683998df2ee45ddb0a6fe9ccbea6a76; no voters: 47ee3179df93431e978cc7053fc07364, a6651948c61f438999e61d22c33787e6
I20260808 14:42:59.191956 20924 raft_consensus.cc:2726] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:42:59.197557 20925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:59.197379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:57747)
0808 14:42:59.197493 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:59.197522 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":65,"threads_started":1}
I20260808 14:42:59.259290 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:59.259081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:48387)
0808 14:42:59.259219 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:59.259255 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260808 14:42:59.395119 20927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:42:59.394854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:50457)
0808 14:42:59.395047 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:42:59.395081 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":58,"threads_started":1}
I20260808 14:43:00.198339 20928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:00.198039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:52979)
0808 14:43:00.198251 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:00.198292 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":64,"threads_started":1}
I20260808 14:43:00.259974 20929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:00.259740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:55993)
0808 14:43:00.259904 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:00.259938 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260808 14:43:00.395854 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:00.395625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:46309)
0808 14:43:00.395784 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:00.395817 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260808 14:43:01.199220 20931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:01.198974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:52953)
0808 14:43:01.199131 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:01.199171 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260808 14:43:01.260742 20932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:01.260543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:52961)
0808 14:43:01.260674 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:01.260705 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
I20260808 14:43:01.396528 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:01.396281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:53077)
0808 14:43:01.396438 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:01.396486 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":79,"threads_started":1}
I20260808 14:43:02.199944 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:02.199714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:35607)
0808 14:43:02.199856 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:02.199888 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260808 14:43:02.261492 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:02.261265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:43137)
0808 14:43:02.261398 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:02.261442 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260808 14:43:02.397228 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:02.397015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:56255)
0808 14:43:02.397161 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:02.397189 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":98,"threads_started":1}
I20260808 14:43:03.200629 20943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:03.200423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:60013)
0808 14:43:03.200548 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:03.200584 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260808 14:43:03.262224 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:03.262053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:49937)
0808 14:43:03.262163 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:03.262192 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260808 14:43:03.398036 20945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:03.397752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:58437)
0808 14:43:03.397962 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:03.397996 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
I20260808 14:43:03.976608 20946 raft_consensus.cc:482] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:43:03.976719 20946 raft_consensus.cc:504] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6651948c61f438999e61d22c33787e6" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 45109 } } peers { permanent_uuid: "47ee3179df93431e978cc7053fc07364" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38857 } } peers { permanent_uuid: "a683998df2ee45ddb0a6fe9ccbea6a76" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 33637 } }
I20260808 14:43:03.976922 20946 leader_election.cc:288] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109), 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857)
W20260808 14:43:03.977317 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47ee3179df93431e978cc7053fc07364 (127.29.168.194:38857): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
W20260808 14:43:03.977406 20340 leader_election.cc:341] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a6651948c61f438999e61d22c33787e6 (127.29.168.195:45109): Not found: Tablet not found: 3d5255ae6dad41dc8f7d284e00b86856
I20260808 14:43:03.977444 20340 leader_election.cc:302] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a683998df2ee45ddb0a6fe9ccbea6a76; no voters: 47ee3179df93431e978cc7053fc07364, a6651948c61f438999e61d22c33787e6
I20260808 14:43:03.977555 20946 raft_consensus.cc:2726] T 3d5255ae6dad41dc8f7d284e00b86856 P a683998df2ee45ddb0a6fe9ccbea6a76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:43:04.201417 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:04.201189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:51133)
0808 14:43:04.201331 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:04.201367 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260808 14:43:04.262856 20948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:04.262647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:51345)
0808 14:43:04.262786 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:04.262816 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260808 14:43:04.398656 20950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:04.398445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:41169)
0808 14:43:04.398571 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:04.398604 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260808 14:43:05.202135 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:05.201928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:46185)
0808 14:43:05.202051 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:05.202087 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260808 14:43:05.263386 20954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:05.263195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:58925)
0808 14:43:05.263318 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:05.263349 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260808 14:43:05.399350 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:05.399037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:50509)
0808 14:43:05.399262 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:05.399295 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":84,"threads_started":1}
I20260808 14:43:06.203081 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:06.202732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:46139)
0808 14:43:06.202961 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:06.203019 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":62,"threads_started":1}
I20260808 14:43:06.264020 20957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:06.263845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:55017)
0808 14:43:06.263951 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:06.263984 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260808 14:43:06.400203 20959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:06.399961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:57457)
0808 14:43:06.400113 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:06.400163 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260808 14:43:07.203989 20960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:07.203762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:60793)
0808 14:43:07.203897 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:07.203944 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260808 14:43:07.264582 20961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:07.264394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:39699)
0808 14:43:07.264511 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:07.264541 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260808 14:43:07.400830 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:07.400634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:48237)
0808 14:43:07.400761 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:07.400792 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260808 14:43:08.204697 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:08.204487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.193:36065)
0808 14:43:08.204608 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:08.204654 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260808 14:43:08.265260 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:08.265060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.194:33031)
0808 14:43:08.265193 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:08.265224 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260808 14:43:08.401543 20966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:08.401340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:41411 (local address 127.29.168.195:45429)
0808 14:43:08.401479 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:08.401508 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260808 14:43:08.408936 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 20277
I20260808 14:43:08.421118 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 20502
I20260808 14:43:08.430100 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 20696
2026-08-08T14:43:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18300 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:43:08 dist-test-slave-mjjr krb5kdc[20969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:43:08 dist-test-slave-mjjr krb5kdc[20969](info): set up 2 sockets
Aug 08 14:43:08 dist-test-slave-mjjr krb5kdc[20969](info): commencing operation
krb5kdc: starting...
W20260808 14:43:09.592284 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:43:09 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:43:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:43:09.704355 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:32777
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:32777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:09.785122 20985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:09.785353 20985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:09.785393 20985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:09.786646 20985 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:43:09.786711 20985 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:43:09.786747 20985 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:43:09.786780 20985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:43:09.786813 20985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:09.786847 20985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:09.786881 20985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:43:09.786916 20985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:43:09.788542 20985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:32777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:32777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:09.788828 20985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:09.789034 20985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:09.793788 20993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:09.793830 20994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:09.794006 20985 server_base.cc:1034] running on GCE node
W20260808 14:43:09.794070 20997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:09.794278 20985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:09.794514 20985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:09.795743 20985 hybrid_clock.cc:648] HybridClock initialized: now 1786200189795698 us; error 34 us; skew 500 ppm
Aug 08 14:43:09 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200189, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:09.798311 20985 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:43:09.798755 20985 webserver.cc:460] Webserver started at http://127.29.168.254:39665/ using document root <none> and password file <none>
I20260808 14:43:09.798988 20985 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:09.799054 20985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:09.799180 20985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:43:09.800209 20985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "3a6a86f23bc2484cafa6aa6525f52358"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "8b8c8bbd497e01ba2306331a05d6d4b7"
server_key_iv: "550bc70772789b23c28108db80c47921"
server_key_version: "encryptionkey@0"
I20260808 14:43:09.800590 20985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "3a6a86f23bc2484cafa6aa6525f52358"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "8b8c8bbd497e01ba2306331a05d6d4b7"
server_key_iv: "550bc70772789b23c28108db80c47921"
server_key_version: "encryptionkey@0"
I20260808 14:43:09.801927 20985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:43:09.802630 21004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:09.802824 20985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:43:09.802927 20985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "3a6a86f23bc2484cafa6aa6525f52358"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "8b8c8bbd497e01ba2306331a05d6d4b7"
server_key_iv: "550bc70772789b23c28108db80c47921"
server_key_version: "encryptionkey@0"
I20260808 14:43:09.803017 20985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:09.810860 20985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:09.812642 20985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:09.812812 20985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:09.817096 20985 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:32777
I20260808 14:43:09.817126 21085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:32777 every 8 connection(s)
I20260808 14:43:09.817452 20985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:43:09.818359 21086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:09.818514 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 20985
I20260808 14:43:09.818652 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:43:09.818850 30371 external_mini_cluster.cc:1428] Setting key a1a6a19763542b90092c19302ffcfe9d
I20260808 14:43:09.821553 21086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap starting.
I20260808 14:43:09.822304 21086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:09.822603 21086 log.cc:824] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:09.823268 21086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: No bootstrap required, opened a new log
Aug 08 14:43:09 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:09.825171 21086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:09.825358 21086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:09.825407 21086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6a86f23bc2484cafa6aa6525f52358, State: Initialized, Role: FOLLOWER
I20260808 14:43:09.825577 21086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:09.825668 21086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:43:09.825726 21086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:43:09.825778 21086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:09.826524 21086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:09.826639 21086 leader_election.cc:302] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a6a86f23bc2484cafa6aa6525f52358; no voters:
I20260808 14:43:09.826805 21086 leader_election.cc:288] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:43:09.826838 21093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:43:09.826959 21093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 LEADER]: Becoming Leader. State: Replica: 3a6a86f23bc2484cafa6aa6525f52358, State: Running, Role: LEADER
I20260808 14:43:09.827073 21086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:43:09.827224 21093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:09.827561 21095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a6a86f23bc2484cafa6aa6525f52358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } } }
I20260808 14:43:09.827698 21095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: This master's current role is: LEADER
I20260808 14:43:09.827877 21096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a6a86f23bc2484cafa6aa6525f52358. Latest consensus state: current_term: 1 leader_uuid: "3a6a86f23bc2484cafa6aa6525f52358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } } }
I20260808 14:43:09.827940 21096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: This master's current role is: LEADER
W20260808 14:43:09.829053 21111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:43:09.829165 21111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:43:09.829231 21101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:43:09.829376 21101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:43:09.829504 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:09.819326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.29.168.254:32777)
0808 14:43:09.819534 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:09.819548 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:09.819588 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:43:09.820081 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:09.820088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:09.820132 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:09.820236 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:09.821002 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:09.821818 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:09.822954 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:09.823350 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:09.823456 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:09.825726 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:09.825729 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:09.825730 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:09.825749 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:09.827722 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:09.828120 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:09.828124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:09.828124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:09.828223 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:09.828424 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:09.828425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:09.828426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:09.828767 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:09.828961 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:09.829041 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:43:09.829285 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":110,"threads_started":1}
I20260808 14:43:09.830747 21101 catalog_manager.cc:1347] Generated new cluster ID: ac6cc5687abd430a8491146ffe87ca31
I20260808 14:43:09.830811 21101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:43:09.844760 21101 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:43:09.845214 21101 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:43:09.850267 21101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Generated new TSK 0
I20260808 14:43:09.850432 21101 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:43:09.887686 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:32777
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:09.978753 21124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:09.978932 21124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:09.978961 21124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:09.980014 21124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:09.980046 21124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:09.980068 21124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:43:09.981400 21124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:09.981623 21124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:09.981834 21124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:09.986557 21135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:09.986565 21131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:09.986577 21133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:09.986651 21124 server_base.cc:1034] running on GCE node
I20260808 14:43:09.986994 21124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:09.987246 21124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:09.988412 21124 hybrid_clock.cc:648] HybridClock initialized: now 1786200189988402 us; error 40 us; skew 500 ppm
Aug 08 14:43:09 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200189, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:09.990808 21124 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:43:09.991207 21124 webserver.cc:460] Webserver started at http://127.29.168.193:46821/ using document root <none> and password file <none>
I20260808 14:43:09.991425 21124 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:09.991490 21124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:09.991618 21124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:43:09.992686 21124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "daca84376b4e4293b2ea2a62bff35132"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "0790bd73be1707a73ad599ea4acf5add"
server_key_iv: "027882da1da6b6abb132be4543fdb5c3"
server_key_version: "encryptionkey@0"
I20260808 14:43:09.992974 21124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "daca84376b4e4293b2ea2a62bff35132"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "0790bd73be1707a73ad599ea4acf5add"
server_key_iv: "027882da1da6b6abb132be4543fdb5c3"
server_key_version: "encryptionkey@0"
I20260808 14:43:09.994154 21124 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:43:09.994773 21145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:09.994951 21124 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:43:09.995016 21124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "daca84376b4e4293b2ea2a62bff35132"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "0790bd73be1707a73ad599ea4acf5add"
server_key_iv: "027882da1da6b6abb132be4543fdb5c3"
server_key_version: "encryptionkey@0"
I20260808 14:43:09.995062 21124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:10.016043 21124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:10.017735 21124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:10.017833 21124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:10.018006 21124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:10.018301 21124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:10.018356 21124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.018386 21124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:10.018410 21124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.023940 21124 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38307
I20260808 14:43:10.023980 21317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38307 every 8 connection(s)
I20260808 14:43:10.024294 21124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:43:10 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200189, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:10.032881 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.025045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:53875 (local address 127.29.168.254:32777)
0808 14:43:10.025125 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.025127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.025295 (+ 168us) server_negotiation.cc:407] Connection header received
0808 14:43:10.025743 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.025744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.025752 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.025803 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:10.026709 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.027258 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.028308 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.028510 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.028564 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.030520 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:10.030521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:10.030521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:10.030528 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:10.031790 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.032115 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.032116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.032117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.032162 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.032350 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.032351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.032351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.032440 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:10.032487 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.032742 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.032806 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:43:10.032888 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 21124
I20260808 14:43:10.033026 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:43:10.033195 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.024989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:53875)
0808 14:43:10.025154 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.025209 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.025665 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.025849 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.025852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.026404 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:10.026623 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.026628 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.027338 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.027339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.028213 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.028216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.028581 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.028581 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.028670 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.029164 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:10.029172 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:10.030422 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:10.031853 (+ 1431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:10.031859 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:10.031861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:10.032054 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:10.032216 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:10.032217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:10.032217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:10.032303 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:10.032492 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:10.032497 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:10.032612 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.032728 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.032934 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260808 14:43:10.033253 30371 external_mini_cluster.cc:1428] Setting key 2dba9759943d2d8d10ffb3c060e570f7
I20260808 14:43:10.033752 21320 heartbeater.cc:347] Connected to a master server at 127.29.168.254:32777
I20260808 14:43:10.033859 21320 heartbeater.cc:464] Registering TS with master...
I20260808 14:43:10.034062 21320 heartbeater.cc:511] Master 127.29.168.254:32777 requested a full tablet report, sending...
I20260808 14:43:10.034610 21031 ts_manager.cc:194] Registered new tserver with Master: daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307)
I20260808 14:43:10.035423 21031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:53875
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:43:10.056627 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:32777
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:10.135097 21327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:10.135277 21327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:10.135298 21327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:10.136471 21327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:10.136509 21327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:10.136535 21327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:43:10.137856 21327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:10.138015 21327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:10.138182 21327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:10.143005 21339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:10.142995 21342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:10.143251 21327 server_base.cc:1034] running on GCE node
W20260808 14:43:10.143011 21338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:10.143545 21327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:10.143819 21327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:10.144963 21327 hybrid_clock.cc:648] HybridClock initialized: now 1786200190144945 us; error 36 us; skew 500 ppm
Aug 08 14:43:10 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200190, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:10.147322 21327 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:43:10.147760 21327 webserver.cc:460] Webserver started at http://127.29.168.194:45137/ using document root <none> and password file <none>
I20260808 14:43:10.147926 21327 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:10.147967 21327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:10.148046 21327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:43:10.148898 21327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "54329925f39e4f64ac9f5202b3bf1e3f"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "e5d3674f5dacbe691ac188f705ec7bae"
server_key_iv: "bdfdc9663023ca3331db42ea44c6a560"
server_key_version: "encryptionkey@0"
I20260808 14:43:10.149181 21327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "54329925f39e4f64ac9f5202b3bf1e3f"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "e5d3674f5dacbe691ac188f705ec7bae"
server_key_iv: "bdfdc9663023ca3331db42ea44c6a560"
server_key_version: "encryptionkey@0"
I20260808 14:43:10.150386 21327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:43:10.151075 21349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.151233 21327 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:43:10.151343 21327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "54329925f39e4f64ac9f5202b3bf1e3f"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "e5d3674f5dacbe691ac188f705ec7bae"
server_key_iv: "bdfdc9663023ca3331db42ea44c6a560"
server_key_version: "encryptionkey@0"
I20260808 14:43:10.151407 21327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:10.160811 21327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:10.162508 21327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:10.162617 21327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:10.162791 21327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:10.163111 21327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:10.163146 21327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.163167 21327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:10.163219 21327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.169225 21327 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:44485
I20260808 14:43:10.169282 21509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:44485 every 8 connection(s)
I20260808 14:43:10.169610 21327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:43:10.171572 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 21327
I20260808 14:43:10.171725 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:43:10.171996 30371 external_mini_cluster.cc:1428] Setting key cff94d657786944330eba2dd2fc65184
Aug 08 14:43:10 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200190, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:10.179857 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.170369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:39875 (local address 127.29.168.254:32777)
0808 14:43:10.170427 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.170429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.170650 (+ 221us) server_negotiation.cc:407] Connection header received
0808 14:43:10.171169 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.171170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.171183 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.171242 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:10.172585 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.173294 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.174251 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.174563 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.174628 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.177013 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:10.177015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:10.177015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:10.177023 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:10.178454 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.178864 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.178866 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.178866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.178934 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.179195 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.179196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.179197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.179311 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:10.179390 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.179681 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.179766 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:43:10.180039 21512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.170327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:39875)
0808 14:43:10.170530 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.170565 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.171059 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.171308 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.171312 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.172205 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:10.172480 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.172485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.173390 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.173391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.174162 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.174164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.174650 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.174652 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.174782 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.175307 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:10.175315 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:10.176910 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:10.178560 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:10.178568 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:10.178570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:10.178785 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:10.179004 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:10.179005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:10.179006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:10.179125 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:10.179382 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:10.179389 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:10.179528 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.179631 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.179811 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":99,"threads_started":1}
I20260808 14:43:10.180521 21510 heartbeater.cc:347] Connected to a master server at 127.29.168.254:32777
I20260808 14:43:10.180650 21510 heartbeater.cc:464] Registering TS with master...
I20260808 14:43:10.180848 21510 heartbeater.cc:511] Master 127.29.168.254:32777 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
I20260808 14:43:10.181238 21031 ts_manager.cc:194] Registered new tserver with Master: 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
I20260808 14:43:10.181715 21031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:39875
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:43:10.197825 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:32777
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:10.276646 21518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:10.276822 21518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:10.276845 21518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:10.277977 21518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:10.278019 21518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:10.278074 21518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:43:10.279490 21518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:10.279721 21518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:10.279927 21518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:10.285019 21526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:10.285005 21525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:10.284992 21529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:10.285216 21518 server_base.cc:1034] running on GCE node
I20260808 14:43:10.285422 21518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:10.285712 21518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:10.286852 21518 hybrid_clock.cc:648] HybridClock initialized: now 1786200190286831 us; error 36 us; skew 500 ppm
Aug 08 14:43:10 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200190, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:10.289388 21518 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:43:10.289837 21518 webserver.cc:460] Webserver started at http://127.29.168.195:44565/ using document root <none> and password file <none>
I20260808 14:43:10.290082 21518 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:10.290127 21518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:10.290262 21518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:43:10.291299 21518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "729c04333ec64978b0c8ce405814235c"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "210a25f0decc81c19c52ed2bb4d9eda3"
server_key_iv: "4ea45bf4533153eede18b539221b6f6b"
server_key_version: "encryptionkey@0"
I20260808 14:43:10.291683 21518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "729c04333ec64978b0c8ce405814235c"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "210a25f0decc81c19c52ed2bb4d9eda3"
server_key_iv: "4ea45bf4533153eede18b539221b6f6b"
server_key_version: "encryptionkey@0"
I20260808 14:43:10.292980 21518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:43:10.293699 21543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.293870 21518 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:43:10.293975 21518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "729c04333ec64978b0c8ce405814235c"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "210a25f0decc81c19c52ed2bb4d9eda3"
server_key_iv: "4ea45bf4533153eede18b539221b6f6b"
server_key_version: "encryptionkey@0"
I20260808 14:43:10.294054 21518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:10.318815 21518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:10.320531 21518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:10.320690 21518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:10.320905 21518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:10.321205 21518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:10.321261 21518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.321300 21518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:10.321324 21518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:10.327219 21518 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:39455
I20260808 14:43:10.327289 21709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:39455 every 8 connection(s)
I20260808 14:43:10.327636 21518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:43:10.332304 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 21518
I20260808 14:43:10.332449 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:43:10.332639 30371 external_mini_cluster.cc:1428] Setting key 0b200fdaf4e6abebb678c7019ef3c789
Aug 08 14:43:10 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200190, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:10.336783 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.328317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:43069 (local address 127.29.168.254:32777)
0808 14:43:10.328376 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.328379 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.328673 (+ 294us) server_negotiation.cc:407] Connection header received
0808 14:43:10.329180 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.329181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.329191 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.329297 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:10.330144 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.330618 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.331464 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.331722 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.331805 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.334220 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:10.334221 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:10.334222 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:10.334228 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:10.335612 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.336001 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.336002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.336002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.336052 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.336291 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.336292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.336292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.336388 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:10.336439 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.336662 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.336721 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:43:10.336969 21715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.328315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:43069)
0808 14:43:10.328538 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.328580 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.329089 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.329345 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.329348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.329889 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:10.330064 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.330069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.330695 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.330696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.331394 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.331396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.331815 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.331816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.331916 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.332441 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:10.332460 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:10.334131 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:10.335748 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:10.335757 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:10.335758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:10.335940 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:10.336108 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:10.336108 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:10.336109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:10.336236 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:10.336443 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:10.336454 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:10.336555 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.336635 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.336744 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260808 14:43:10.337416 21711 heartbeater.cc:347] Connected to a master server at 127.29.168.254:32777
I20260808 14:43:10.337509 21711 heartbeater.cc:464] Registering TS with master...
I20260808 14:43:10.337663 21711 heartbeater.cc:511] Master 127.29.168.254:32777 requested a full tablet report, sending...
I20260808 14:43:10.338050 21031 ts_manager.cc:194] Registered new tserver with Master: 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455)
I20260808 14:43:10.338428 21031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:43069
I20260808 14:43:10.344141 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:43:10.350927 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.345396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36530 (local address 127.29.168.254:32777)
0808 14:43:10.345466 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.345468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.345505 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:43:10.345553 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.345554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.345562 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.345612 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:10.346094 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.346549 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.347216 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.347393 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.347440 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.348567 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:10.348568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:10.348568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:10.348573 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:10.349706 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.350035 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.350035 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.350036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.350084 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:10.350327 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:10.350328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:10.350328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:10.350509 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:10.350583 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.350729 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.350810 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:43:10.352571 21031 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:43:10.354147 21031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:43:10.360733 21726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.356629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:44485 (local address 127.0.0.1:52464)
0808 14:43:10.356949 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.356958 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.357012 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.357306 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.357307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.357310 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:10.357366 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.357368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.358267 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.358268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.359470 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.359473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.360424 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.360425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.360495 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.360507 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.360593 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.360660 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":75,"threads_started":1}
I20260808 14:43:10.360940 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.356401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38307 (local address 127.0.0.1:48550)
0808 14:43:10.356728 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.356769 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.356850 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.357239 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.357242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.357244 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:10.357307 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.357309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.358651 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.358652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.359724 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.359726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.360545 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.360546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.360617 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.360620 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.360674 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.360701 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":27,"thread_start_us":77,"threads_started":1}
I20260808 14:43:10.360939 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.356552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48550 (local address 127.29.168.193:38307)
0808 14:43:10.356981 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.356985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.356996 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:43:10.357037 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.357040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.357057 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.357138 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:10.357395 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.358531 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.359813 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.360393 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.360461 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.360514 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.360775 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.360823 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":72,"threads_started":1}
I20260808 14:43:10.361124 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.356472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:39455 (local address 127.0.0.1:41660)
0808 14:43:10.356750 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.356779 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.356856 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.357355 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.357356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.357357 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:10.357402 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.357403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.358643 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.358644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.359872 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.359874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.360808 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.360809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.360882 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.360886 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.360959 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.361003 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":23,"thread_start_us":88,"threads_started":1}
I20260808 14:43:10.361352 21729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.356564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.29.168.195:39455)
0808 14:43:10.357148 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.357152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.357163 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:43:10.357194 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.357196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.357210 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.357281 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:10.357494 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.358530 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.359961 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.360666 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.360730 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.360773 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.361239 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.361279 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":80,"threads_started":1}
I20260808 14:43:10.360759 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.356737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52464 (local address 127.29.168.194:44485)
0808 14:43:10.356940 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.356945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.357003 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:43:10.357084 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.357085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.357097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.357189 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:10.357466 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.358164 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.359559 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.360299 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.360401 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.360457 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.360622 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.360673 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
I20260808 14:43:10.361760 21223 tablet_service.cc:1467] Processing CreateTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 (DEFAULT_TABLE table=test-table [id=b8459577daf94b9fa30992b62c656397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:43:10.362109 21223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac06764a76ad48cb87c83f76cb9fcf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:10.362054 21414 tablet_service.cc:1467] Processing CreateTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 (DEFAULT_TABLE table=test-table [id=b8459577daf94b9fa30992b62c656397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:43:10.362296 21414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac06764a76ad48cb87c83f76cb9fcf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:10.364643 21732 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Bootstrap starting.
I20260808 14:43:10.364926 21734 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Bootstrap starting.
I20260808 14:43:10.365052 21611 tablet_service.cc:1467] Processing CreateTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 (DEFAULT_TABLE table=test-table [id=b8459577daf94b9fa30992b62c656397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:43:10.365352 21611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac06764a76ad48cb87c83f76cb9fcf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:10.365396 21732 tablet_bootstrap.cc:654] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:10.365648 21734 tablet_bootstrap.cc:654] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:10.365983 21732 log.cc:824] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:10.366222 21734 log.cc:824] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:10.366807 21732 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: No bootstrap required, opened a new log
I20260808 14:43:10.366891 21732 ts_tablet_manager.cc:1397] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:43:10.368212 21734 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: No bootstrap required, opened a new log
I20260808 14:43:10.368306 21734 ts_tablet_manager.cc:1397] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:43:10.368695 21739 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Bootstrap starting.
I20260808 14:43:10.368913 21732 raft_consensus.cc:348] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.369061 21732 raft_consensus.cc:374] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:10.369102 21732 raft_consensus.cc:729] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54329925f39e4f64ac9f5202b3bf1e3f, State: Initialized, Role: FOLLOWER
I20260808 14:43:10.369197 21732 consensus_queue.cc:260] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.369324 21739 tablet_bootstrap.cc:654] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:10.369491 21732 ts_tablet_manager.cc:1428] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:43:10.369509 21510 heartbeater.cc:503] Master 127.29.168.254:32777 was elected leader, sending a full tablet report...
I20260808 14:43:10.369834 21739 log.cc:824] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:10.370292 21734 raft_consensus.cc:348] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.370460 21734 raft_consensus.cc:374] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:10.370503 21734 raft_consensus.cc:729] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daca84376b4e4293b2ea2a62bff35132, State: Initialized, Role: FOLLOWER
I20260808 14:43:10.370620 21734 consensus_queue.cc:260] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.370716 21739 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: No bootstrap required, opened a new log
I20260808 14:43:10.370785 21739 ts_tablet_manager.cc:1397] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:43:10.370896 21734 ts_tablet_manager.cc:1428] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:43:10.370934 21320 heartbeater.cc:503] Master 127.29.168.254:32777 was elected leader, sending a full tablet report...
I20260808 14:43:10.372664 21739 raft_consensus.cc:348] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.372776 21739 raft_consensus.cc:374] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:10.372795 21739 raft_consensus.cc:729] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729c04333ec64978b0c8ce405814235c, State: Initialized, Role: FOLLOWER
I20260808 14:43:10.372890 21739 consensus_queue.cc:260] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.373135 21739 ts_tablet_manager.cc:1428] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:43:10.373169 21711 heartbeater.cc:503] Master 127.29.168.254:32777 was elected leader, sending a full tablet report...
W20260808 14:43:10.420261 21511 tablet.cc:2369] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:43:10.525094 21322 tablet.cc:2369] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:43:10.578285 21713 tablet.cc:2369] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:43:10.639545 21740 raft_consensus.cc:482] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:43:10.639694 21740 raft_consensus.cc:504] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.640093 21740 leader_election.cc:288] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307), 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455)
I20260808 14:43:10.642944 21729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.640364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:41257 (local address 127.29.168.195:39455)
0808 14:43:10.640427 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.640429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.640599 (+ 170us) server_negotiation.cc:407] Connection header received
0808 14:43:10.640646 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.640646 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.640657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.640709 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:10.640865 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.641339 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.642217 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.642581 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.642669 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.642677 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.642828 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.642862 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:43:10.642943 21512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.640276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38307 (local address 127.29.168.194:43963)
0808 14:43:10.640332 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.640344 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.640383 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.640537 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.640538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.640539 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:10.640628 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.640631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.641361 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.641362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.642122 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.642125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.642666 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.642667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.642751 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.642754 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.642823 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.642862 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":45}
I20260808 14:43:10.642939 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.640352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:43963 (local address 127.29.168.193:38307)
0808 14:43:10.640394 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.640395 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.640405 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:43:10.640434 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.640435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.640443 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.640509 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:10.640732 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.641260 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.642222 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.642577 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.642668 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.642677 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.642832 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.642868 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:43:10.642959 21746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.640279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:39455 (local address 127.29.168.194:41257)
0808 14:43:10.640525 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.640534 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:10.640581 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:10.640731 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:10.640731 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:10.640733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:10.640799 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.640801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.641427 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.641428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.642127 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:10.642129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.642672 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.642673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:10.642749 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.642753 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:43:10.642824 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:43:10.642864 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":18,"thread_start_us":126,"threads_started":1}
I20260808 14:43:10.643287 21251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac06764a76ad48cb87c83f76cb9fcf88" candidate_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daca84376b4e4293b2ea2a62bff35132" is_pre_election: true
I20260808 14:43:10.643334 21642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac06764a76ad48cb87c83f76cb9fcf88" candidate_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729c04333ec64978b0c8ce405814235c" is_pre_election: true
I20260808 14:43:10.643445 21251 raft_consensus.cc:2454] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54329925f39e4f64ac9f5202b3bf1e3f in term 0.
I20260808 14:43:10.643445 21642 raft_consensus.cc:2454] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54329925f39e4f64ac9f5202b3bf1e3f in term 0.
I20260808 14:43:10.643740 21353 leader_election.cc:302] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54329925f39e4f64ac9f5202b3bf1e3f, daca84376b4e4293b2ea2a62bff35132; no voters:
I20260808 14:43:10.643903 21740 raft_consensus.cc:2781] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:43:10.643965 21740 raft_consensus.cc:482] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:43:10.644001 21740 raft_consensus.cc:3037] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:10.644824 21740 raft_consensus.cc:504] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.644971 21740 leader_election.cc:288] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [CANDIDATE]: Term 1 election: Requested vote from peers daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307), 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455)
I20260808 14:43:10.645140 21642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac06764a76ad48cb87c83f76cb9fcf88" candidate_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729c04333ec64978b0c8ce405814235c"
I20260808 14:43:10.645169 21251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac06764a76ad48cb87c83f76cb9fcf88" candidate_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daca84376b4e4293b2ea2a62bff35132"
I20260808 14:43:10.645231 21642 raft_consensus.cc:3037] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:10.645226 21251 raft_consensus.cc:3037] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:10.645928 21642 raft_consensus.cc:2454] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54329925f39e4f64ac9f5202b3bf1e3f in term 1.
I20260808 14:43:10.646042 21251 raft_consensus.cc:2454] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54329925f39e4f64ac9f5202b3bf1e3f in term 1.
I20260808 14:43:10.646165 21354 leader_election.cc:302] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54329925f39e4f64ac9f5202b3bf1e3f, 729c04333ec64978b0c8ce405814235c; no voters:
I20260808 14:43:10.646293 21740 raft_consensus.cc:2781] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:43:10.646442 21740 raft_consensus.cc:686] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 LEADER]: Becoming Leader. State: Replica: 54329925f39e4f64ac9f5202b3bf1e3f, State: Running, Role: LEADER
I20260808 14:43:10.646564 21740 consensus_queue.cc:237] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:10.647415 21031 catalog_manager.cc:5495] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194). New cstate: current_term: 1 leader_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } health_report { overall_health: UNKNOWN } } }
I20260808 14:43:10.711743 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.709380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52480 (local address 127.29.168.194:44485)
0808 14:43:10.709437 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:10.709439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:10.709458 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:43:10.709502 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:10.709503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:10.709518 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:10.709588 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:43:10.709782 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.710233 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.710970 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:10.711160 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:10.711232 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:10.711384 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:43:10.711499 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:43:10.711601 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:10.711618 (+ 17us) server_negotiation.cc:299] Negotiation successful
0808 14:43:10.711636 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:43:10.713392 21642 raft_consensus.cc:1261] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Refusing update from remote peer 54329925f39e4f64ac9f5202b3bf1e3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:43:10.713457 21251 raft_consensus.cc:1261] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Refusing update from remote peer 54329925f39e4f64ac9f5202b3bf1e3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:43:10.713729 21740 consensus_queue.cc:1035] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:43:10.713867 21747 consensus_queue.cc:1035] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:43:10.715893 21754 mvcc.cc:205] Tried to move back new op lower bound from 7316275981159731200 to 7316275980888858624. Current Snapshot: MvccSnapshot[applied={T|T < 7316275981159731200}]
I20260808 14:43:10.716769 21756 mvcc.cc:205] Tried to move back new op lower bound from 7316275981159731200 to 7316275980888858624. Current Snapshot: MvccSnapshot[applied={T|T < 7316275981159731200 or (T in {7316275981159731200})}]
I20260808 14:43:10.718187 21032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:43:10.718281 21032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:43:10.719017 21032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Sending DeleteTablet for 3 replicas of tablet ac06764a76ad48cb87c83f76cb9fcf88
I20260808 14:43:10.719328 21611 tablet_service.cc:1514] Processing DeleteTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:43:10 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41660
I20260808 14:43:10.719375 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 21124
I20260808 14:43:10.719441 21223 tablet_service.cc:1514] Processing DeleteTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:43:10 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:48550
I20260808 14:43:10.721740 21414 tablet_service.cc:1514] Processing DeleteTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:43:10 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:52464
I20260808 14:43:10.723428 21765 tablet_replica.cc:330] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: stopping tablet replica
I20260808 14:43:10.723515 21765 raft_consensus.cc:2229] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:43:10.723598 21765 raft_consensus.cc:2258] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:43:10.724187 21765 ts_tablet_manager.cc:1905] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:43:10.725744 21766 tablet_replica.cc:330] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: stopping tablet replica
I20260808 14:43:10.725839 21766 raft_consensus.cc:2229] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:43:10.725929 21766 raft_consensus.cc:2258] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:43:10.725936 21765 ts_tablet_manager.cc:1918] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:43:10.725998 21765 log.cc:1196] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/ac06764a76ad48cb87c83f76cb9fcf88
I20260808 14:43:10.726310 21765 ts_tablet_manager.cc:1939] T ac06764a76ad48cb87c83f76cb9fcf88 P 729c04333ec64978b0c8ce405814235c: Deleting consensus metadata
I20260808 14:43:10.726375 21766 ts_tablet_manager.cc:1905] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:43:10.726723 21011 catalog_manager.cc:4841] TS 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): tablet ac06764a76ad48cb87c83f76cb9fcf88 (table test-table [id=b8459577daf94b9fa30992b62c656397]) successfully deleted
I20260808 14:43:10.728574 21766 ts_tablet_manager.cc:1918] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:43:10.728653 21766 log.cc:1196] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/ac06764a76ad48cb87c83f76cb9fcf88
I20260808 14:43:10.728919 21766 ts_tablet_manager.cc:1939] T ac06764a76ad48cb87c83f76cb9fcf88 P 54329925f39e4f64ac9f5202b3bf1e3f: Deleting consensus metadata
I20260808 14:43:10.729323 21009 catalog_manager.cc:4841] TS 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): tablet ac06764a76ad48cb87c83f76cb9fcf88 (table test-table [id=b8459577daf94b9fa30992b62c656397]) successfully deleted
W20260808 14:43:10.731174 21009 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:38307 (error 108)
I20260808 14:43:10.731455 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 21327
I20260808 14:43:10.733219 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:10.731549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38307 (local address 127.0.0.1:48558)
0808 14:43:10.733152 (+ 1603us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:10.733194 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1575}
W20260808 14:43:10.733377 21009 catalog_manager.cc:4584] TS daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac06764a76ad48cb87c83f76cb9fcf88: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38307: connect: Connection refused (error 111)
I20260808 14:43:10.740888 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 21518
I20260808 14:43:10.747087 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 20985
I20260808 14:43:30.756614 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:32777
--webserver_interface=127.29.168.254
--webserver_port=39665
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:32777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:30.838115 21769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:30.838296 21769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:30.838318 21769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:30.839440 21769 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:43:30.839485 21769 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:43:30.839497 21769 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:43:30.839509 21769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:43:30.839555 21769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:30.839571 21769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:30.839592 21769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:43:30.839615 21769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:43:30.841012 21769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:32777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:32777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:30.841173 21769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:30.841403 21769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:30.850829 21775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:30.850867 21778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:30.850883 21769 server_base.cc:1034] running on GCE node
W20260808 14:43:30.850871 21776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:30.851392 21769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:30.851704 21769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:30.852849 21769 hybrid_clock.cc:648] HybridClock initialized: now 1786200210852831 us; error 35 us; skew 500 ppm
Aug 08 14:43:30 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200210, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:30.858078 21769 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:43:30.858443 21769 webserver.cc:460] Webserver started at http://127.29.168.254:39665/ using document root <none> and password file <none>
I20260808 14:43:30.858691 21769 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:30.858767 21769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:30.860127 21769 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:43:30.860751 21791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:30.860924 21769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:43:30.861007 21769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "3a6a86f23bc2484cafa6aa6525f52358"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "8b8c8bbd497e01ba2306331a05d6d4b7"
server_key_iv: "550bc70772789b23c28108db80c47921"
server_key_version: "encryptionkey@0"
I20260808 14:43:30.861312 21769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:30.870357 21769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:30.872015 21769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:30.872153 21769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:30.876003 21769 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:32777
I20260808 14:43:30.876034 21865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:32777 every 8 connection(s)
I20260808 14:43:30.876382 21769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:43:30.877844 21867 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:43:30.878525 21867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap starting.
I20260808 14:43:30.882629 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 21769
I20260808 14:43:30.882921 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:38307
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:32777
--webserver_port=46821
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:43:30.887781 21867 log.cc:824] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:30.889575 21867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:43:30.889882 21867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap complete.
I20260808 14:43:30.892048 21867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:30.892267 21867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6a86f23bc2484cafa6aa6525f52358, State: Initialized, Role: FOLLOWER
I20260808 14:43:30.892489 21867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:30.892609 21867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:43:30.892666 21867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:43:30.892714 21867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:43:30.893637 21867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:30.893754 21867 leader_election.cc:302] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a6a86f23bc2484cafa6aa6525f52358; no voters:
I20260808 14:43:30.893944 21867 leader_election.cc:288] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:43:30.893978 21873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:43:30.894094 21873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 LEADER]: Becoming Leader. State: Replica: 3a6a86f23bc2484cafa6aa6525f52358, State: Running, Role: LEADER
I20260808 14:43:30.894213 21867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:43:30.894238 21873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:30.894647 21874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3a6a86f23bc2484cafa6aa6525f52358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } } }
I20260808 14:43:30.894737 21874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: This master's current role is: LEADER
I20260808 14:43:30.895066 21882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:43:30.895110 21875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a6a86f23bc2484cafa6aa6525f52358. Latest consensus state: current_term: 2 leader_uuid: "3a6a86f23bc2484cafa6aa6525f52358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } } }
I20260808 14:43:30.895254 21875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: This master's current role is: LEADER
I20260808 14:43:30.895885 21882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:43:30.896113 21882 catalog_manager.cc:1259] Loaded cluster ID: ac6cc5687abd430a8491146ffe87ca31
I20260808 14:43:30.896267 21882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:43:30.897361 21882 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:43:30.897536 21882 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Loaded TSK: 0
I20260808 14:43:30.912211 21882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Generated new TSK 1
I20260808 14:43:30.912295 21882 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:43:30.965288 21871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:30.965498 21871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:30.965533 21871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:30.966661 21871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:30.966725 21871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:30.966770 21871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:43:30.968323 21871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:38307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=46821
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:30.968575 21871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:30.968794 21871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:30.973574 21908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:30.973589 21907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:30.973712 21871 server_base.cc:1034] running on GCE node
W20260808 14:43:30.973591 21910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:30.973989 21871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:30.974227 21871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:30.975373 21871 hybrid_clock.cc:648] HybridClock initialized: now 1786200210975355 us; error 33 us; skew 500 ppm
Aug 08 14:43:30 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200210, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:30.977818 21871 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:43:30.978305 21871 webserver.cc:460] Webserver started at http://127.29.168.193:46821/ using document root <none> and password file <none>
I20260808 14:43:30.978544 21871 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:30.978600 21871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:30.979916 21871 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:30.980587 21917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:30.980793 21871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:30.980898 21871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "daca84376b4e4293b2ea2a62bff35132"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "0790bd73be1707a73ad599ea4acf5add"
server_key_iv: "027882da1da6b6abb132be4543fdb5c3"
server_key_version: "encryptionkey@0"
I20260808 14:43:30.981321 21871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:30.995711 21871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:30.997888 21871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:30.998085 21871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:30.998324 21871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:30.998869 21926 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:43:31.000456 21871 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:43:31.000517 21871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:43:31.000550 21871 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:43:31.001410 21871 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:43:31.001457 21871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:43:31.001538 21926 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Bootstrap starting.
I20260808 14:43:31.008538 21871 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38307
I20260808 14:43:31.008975 21871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:43:31.011811 22073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38307 every 8 connection(s)
I20260808 14:43:31.012328 21926 log.cc:824] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:31.014814 21926 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:43:31.015103 21926 tablet_bootstrap.cc:492] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Bootstrap complete.
I20260808 14:43:31.016233 21926 ts_tablet_manager.cc:1397] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.014s
I20260808 14:43:31.017465 21926 raft_consensus.cc:348] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:31.017727 21926 raft_consensus.cc:729] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: daca84376b4e4293b2ea2a62bff35132, State: Initialized, Role: FOLLOWER
I20260808 14:43:31.017894 21926 consensus_queue.cc:260] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } }
I20260808 14:43:31.018224 21926 ts_tablet_manager.cc:1428] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:43:31.018501 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 21871
Aug 08 14:43:31 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200210, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:31.018821 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:44485
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:32777
--webserver_port=45137
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:43:31.023032 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.009844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:50817 (local address 127.29.168.254:32777)
0808 14:43:31.011800 (+ 1956us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.011809 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.011859 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:43:31.012034 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.012041 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.012096 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.012245 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:31.013082 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.014488 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.015851 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.016476 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.016579 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.019333 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:31.019337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:31.019337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:31.019356 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:31.021344 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.021792 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.021795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.021796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.021890 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.022143 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.022144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.022144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.022356 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:31.022442 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.022735 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.022853 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1907,"thread_start_us":74,"threads_started":1}
I20260808 14:43:31.023031 22079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.009717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:50817)
0808 14:43:31.009920 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.009976 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.010568 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.012289 (+ 1721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.012293 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.012693 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:31.012943 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.012960 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.014622 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.014623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.015735 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.015738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.016590 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.016592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.016761 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.017328 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:31.017337 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:31.019192 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:31.021441 (+ 2249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.021448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.021450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.021697 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.021961 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.021961 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.021962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.022072 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.022435 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:31.022442 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:31.022569 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.022667 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.022835 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
I20260808 14:43:31.024013 22074 heartbeater.cc:347] Connected to a master server at 127.29.168.254:32777
I20260808 14:43:31.024101 22074 heartbeater.cc:464] Registering TS with master...
I20260808 14:43:31.024262 22074 heartbeater.cc:511] Master 127.29.168.254:32777 requested a full tablet report, sending...
I20260808 14:43:31.024953 21813 ts_manager.cc:194] Registered new tserver with Master: daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307)
I20260808 14:43:31.026000 21813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:50817
I20260808 14:43:31.026983 22074 heartbeater.cc:503] Master 127.29.168.254:32777 was elected leader, sending a full tablet report...
Aug 08 14:43:31 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200210, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.193@KRBTEST.COM
I20260808 14:43:31.033860 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.025680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36448 (local address 127.29.168.193:38307)
0808 14:43:31.026325 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.026329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.026340 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:43:31.026382 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.026384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.026399 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.026465 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:31.027013 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.028022 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.028757 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.029048 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.029123 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.030977 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:31.030984 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:31.030984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:31.030991 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:31.032600 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.033000 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.033002 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.033003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.033064 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.033270 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.033271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.033272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.033414 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:31.033504 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.033679 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.033772 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":81,"threads_started":1}
I20260808 14:43:31.033871 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.025478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38307 (local address 127.0.0.1:36448)
0808 14:43:31.025827 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.025870 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.025930 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.026558 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.026564 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.026867 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:31.026918 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.026920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.028121 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.028122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.028671 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.028673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.029124 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.029125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.029198 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.029651 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:31.029656 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:31.030883 (+ 1227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:31.032703 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.032710 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.032712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.032913 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.033140 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.033141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.033142 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.033207 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.033485 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:31.033492 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:31.033541 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.033642 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.033768 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":73,"threads_started":1}
I20260808 14:43:31.034543 21958 tablet_service.cc:1514] Processing DeleteTablet for tablet ac06764a76ad48cb87c83f76cb9fcf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:43:10 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:36448
I20260808 14:43:31.034965 22088 tablet_replica.cc:330] stopping tablet replica
I20260808 14:43:31.035084 22088 raft_consensus.cc:2229] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:43:31.035239 22088 raft_consensus.cc:2258] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:43:31.035544 22088 ts_tablet_manager.cc:1905] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:43:31.037581 22088 ts_tablet_manager.cc:1918] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:43:31.037672 22088 log.cc:1196] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal/wals/ac06764a76ad48cb87c83f76cb9fcf88
I20260808 14:43:31.037919 22088 ts_tablet_manager.cc:1939] T ac06764a76ad48cb87c83f76cb9fcf88 P daca84376b4e4293b2ea2a62bff35132: Deleting consensus metadata
I20260808 14:43:31.038432 21795 catalog_manager.cc:4841] TS daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307): tablet ac06764a76ad48cb87c83f76cb9fcf88 (table test-table [id=b8459577daf94b9fa30992b62c656397]) successfully deleted
W20260808 14:43:31.105481 22084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:31.105659 22084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:31.105681 22084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:31.106873 22084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:31.106915 22084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:31.106976 22084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:43:31.108471 22084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:44485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=45137
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:31.108722 22084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:31.108946 22084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:31.113785 22094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:31.113824 22097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:31.113786 22095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:31.113801 22084 server_base.cc:1034] running on GCE node
I20260808 14:43:31.114228 22084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:31.114419 22084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:31.115574 22084 hybrid_clock.cc:648] HybridClock initialized: now 1786200211115561 us; error 27 us; skew 500 ppm
Aug 08 14:43:31 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200211, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:31.118001 22084 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:43:31.118458 22084 webserver.cc:460] Webserver started at http://127.29.168.194:45137/ using document root <none> and password file <none>
I20260808 14:43:31.118671 22084 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:31.118747 22084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:31.120146 22084 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:31.120746 22108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:31.120914 22084 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:43:31.121039 22084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "54329925f39e4f64ac9f5202b3bf1e3f"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "e5d3674f5dacbe691ac188f705ec7bae"
server_key_iv: "bdfdc9663023ca3331db42ea44c6a560"
server_key_version: "encryptionkey@0"
I20260808 14:43:31.121343 22084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:31.136019 22084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:31.137766 22084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:31.137923 22084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:31.138161 22084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:31.138464 22084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:31.138518 22084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:31.138553 22084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:31.138581 22084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:31.144675 22084 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:44485
I20260808 14:43:31.144706 22271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:44485 every 8 connection(s)
I20260808 14:43:31.145081 22084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:43:31.146626 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 22084
I20260808 14:43:31.146944 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:39455
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:32777
--webserver_port=44565
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:43:31 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200211, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:31.155009 22278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.145723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:35161)
0808 14:43:31.145884 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.145915 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.146348 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.146620 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.146623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.147321 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:31.147504 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.147509 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.148529 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.148530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.149292 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.149293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.149709 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.149710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.149826 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.150313 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:31.150321 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:31.151898 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:31.153708 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.153714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.153716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.153930 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.154156 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.154156 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.154156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.154245 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.154564 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:31.154569 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:31.154671 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.154751 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.154857 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260808 14:43:31.155043 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.145759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:35161 (local address 127.29.168.254:32777)
0808 14:43:31.145829 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.145831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.146008 (+ 177us) server_negotiation.cc:407] Connection header received
0808 14:43:31.146447 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.146448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.146464 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.146572 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:31.147600 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.148428 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.149387 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.149609 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.149696 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.152027 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:31.152029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:31.152030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:31.152038 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:31.153633 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.154013 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.154015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.154015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.154089 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.154329 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.154330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.154331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.154486 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:31.154564 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.154802 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.154909 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:43:31.155680 22272 heartbeater.cc:347] Connected to a master server at 127.29.168.254:32777
I20260808 14:43:31.155793 22272 heartbeater.cc:464] Registering TS with master...
I20260808 14:43:31.155958 22272 heartbeater.cc:511] Master 127.29.168.254:32777 requested a full tablet report, sending...
I20260808 14:43:31.156376 21813 ts_manager.cc:194] Registered new tserver with Master: 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
I20260808 14:43:31.156895 21813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:35161
W20260808 14:43:31.227516 22282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:31.227775 22282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:31.227803 22282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:31.228883 22282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:31.228916 22282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:31.228942 22282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:43:31.230278 22282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:39455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=44565
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:31.230444 22282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:31.230600 22282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:31.235366 22290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:31.235376 22288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:31.235553 22282 server_base.cc:1034] running on GCE node
W20260808 14:43:31.235435 22293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:31.235929 22282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:31.236225 22282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:31.237393 22282 hybrid_clock.cc:648] HybridClock initialized: now 1786200211237380 us; error 42 us; skew 500 ppm
Aug 08 14:43:31 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200211, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:31.239917 22282 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:43:31.240334 22282 webserver.cc:460] Webserver started at http://127.29.168.195:44565/ using document root <none> and password file <none>
I20260808 14:43:31.240562 22282 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:31.240643 22282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:31.241876 22282 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:31.242451 22301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:31.242605 22282 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:43:31.242697 22282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "729c04333ec64978b0c8ce405814235c"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "210a25f0decc81c19c52ed2bb4d9eda3"
server_key_iv: "4ea45bf4533153eede18b539221b6f6b"
server_key_version: "encryptionkey@0"
I20260808 14:43:31.242974 22282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:31.258118 22282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:31.260366 22282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:31.260519 22282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:31.260715 22282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:31.260998 22282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:31.261059 22282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:31.261086 22282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:31.261109 22282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:31.266888 22282 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:39455
I20260808 14:43:31.266958 22477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:39455 every 8 connection(s)
I20260808 14:43:31.267290 22282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:43:31.272845 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 22282
Aug 08 14:43:31 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200211, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:43:31.276712 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.267955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:34131 (local address 127.29.168.254:32777)
0808 14:43:31.268036 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.268038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.268263 (+ 225us) server_negotiation.cc:407] Connection header received
0808 14:43:31.268724 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.268725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.268738 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.268798 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:31.269755 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.270257 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.271205 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.271406 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.271488 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.273656 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:31.273658 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:31.273658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:31.273667 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:31.275282 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.275728 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.275729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.275729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.275785 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.276074 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.276075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.276075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.276165 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:31.276212 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.276516 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.276589 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:43:31.276795 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.267955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:34131)
0808 14:43:31.268143 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.268176 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.268620 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.268877 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.268880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.269450 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:31.269637 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.269645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.270349 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.270350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.271111 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.271113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.271487 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.271488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.271608 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.272031 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:31.272039 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:31.273533 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:31.275357 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.275362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.275363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.275648 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.275874 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:31.275875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:31.275875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:31.276010 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:31.276224 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:31.276229 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:31.276366 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.276470 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.276629 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260808 14:43:31.277253 22479 heartbeater.cc:347] Connected to a master server at 127.29.168.254:32777
I20260808 14:43:31.277351 22479 heartbeater.cc:464] Registering TS with master...
I20260808 14:43:31.277519 22479 heartbeater.cc:511] Master 127.29.168.254:32777 requested a full tablet report, sending...
I20260808 14:43:31.277933 21813 ts_manager.cc:194] Registered new tserver with Master: 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455)
I20260808 14:43:31.278404 21813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:34131
I20260808 14:43:31.280679 22484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.273335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42762 (local address 127.29.168.254:32777)
0808 14:43:31.273582 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.273583 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.273654 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:43:31.273766 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.273767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.273778 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.273871 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:31.274619 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.275372 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.276473 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.276781 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.276866 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.278295 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:31.278296 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:31.278296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:31.278302 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:31.279764 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.280073 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.280074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.280074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.280121 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.280279 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.280279 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.280280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.280361 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:31.280475 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.280521 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.280581 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":66,"threads_started":1}
I20260808 14:43:31.281450 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:43:31.283521 22484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.281740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.29.168.254:32777)
0808 14:43:31.281800 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.281801 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.281858 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:43:31.281910 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.281911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.281935 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.281979 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:43:31.282044 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.282423 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.283016 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.283169 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.283212 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.283348 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:43:31.283380 (+ 32us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 14:43:31.283487 (+ 107us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42774: token expired
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 14:43:31.283555 22484 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42774: token expired
W20260808 14:43:31.284437 21718 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.29.168.254:32777)
I20260808 14:43:31.289805 22484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.284693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42778 (local address 127.29.168.254:32777)
0808 14:43:31.284759 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.284760 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.284767 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:43:31.284783 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.284783 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.284789 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.284826 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:31.285253 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.285737 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.286444 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.286626 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.286675 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.287670 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:31.287672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:31.287672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:31.287680 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:31.288948 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.289264 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.289264 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.289265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.289309 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:31.289482 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:31.289482 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:31.289483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:31.289564 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:31.289630 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.289706 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.289757 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:43:31.290889 21813 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:43:31.292490 21813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:43:31.294804 21958 tablet_service.cc:1467] Processing CreateTablet for tablet ed6a02b202584126b806ed5a322703fc (DEFAULT_TABLE table=test-table [id=64b66ec929ff48ca97464b50e69ddcd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:43:31.294992 21958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed6a02b202584126b806ed5a322703fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:31.296293 21926 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Bootstrap starting.
I20260808 14:43:31.296628 21926 tablet_bootstrap.cc:654] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:31.297158 21926 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: No bootstrap required, opened a new log
I20260808 14:43:31.297222 21926 ts_tablet_manager.cc:1397] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:43:31.297616 21926 raft_consensus.cc:348] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.297703 21926 raft_consensus.cc:374] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:31.297762 21926 raft_consensus.cc:729] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daca84376b4e4293b2ea2a62bff35132, State: Initialized, Role: FOLLOWER
I20260808 14:43:31.297809 21926 consensus_queue.cc:260] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.297904 21926 ts_tablet_manager.cc:1428] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:43:31.298638 22488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.294392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:44485 (local address 127.0.0.1:59690)
0808 14:43:31.294528 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.294536 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.294600 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.295181 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.295182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.295184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:31.295225 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.295227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.296401 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.296402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.297539 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.297541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.298390 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.298391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.298451 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.298474 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.298533 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.298571 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":5,"thread_start_us":86,"threads_started":1}
I20260808 14:43:31.298667 22490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.294779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59690 (local address 127.29.168.194:44485)
0808 14:43:31.294958 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.294962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.294972 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:43:31.295011 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.295013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.295027 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.295090 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:31.295302 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.296325 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.297607 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.298298 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.298392 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.298446 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.298549 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.298586 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":118,"threads_started":1}
I20260808 14:43:31.298776 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.294351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:39455 (local address 127.0.0.1:33802)
0808 14:43:31.294387 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.294397 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.294434 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.295092 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.295093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.295095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:31.295131 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.295132 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.296353 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.296354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.297639 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.297641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.298525 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.298526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.298598 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.298602 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.298659 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.298700 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":156}
I20260808 14:43:31.299300 22175 tablet_service.cc:1467] Processing CreateTablet for tablet ed6a02b202584126b806ed5a322703fc (DEFAULT_TABLE table=test-table [id=64b66ec929ff48ca97464b50e69ddcd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:43:31.299715 22175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed6a02b202584126b806ed5a322703fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:31.299798 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.294525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.29.168.195:39455)
0808 14:43:31.294660 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.294664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.294673 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:43:31.294727 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.294729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.294983 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.295070 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:31.295199 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.296251 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.297752 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.298461 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.298528 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.298580 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.298672 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.298705 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260808 14:43:31.300335 22376 tablet_service.cc:1467] Processing CreateTablet for tablet ed6a02b202584126b806ed5a322703fc (DEFAULT_TABLE table=test-table [id=64b66ec929ff48ca97464b50e69ddcd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:43:31.300545 22376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed6a02b202584126b806ed5a322703fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:43:31.302621 22493 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Bootstrap starting.
I20260808 14:43:31.303169 22494 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Bootstrap starting.
I20260808 14:43:31.303349 22493 tablet_bootstrap.cc:654] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:31.303886 22494 tablet_bootstrap.cc:654] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Neither blocks nor log segments found. Creating new log.
I20260808 14:43:31.304015 22493 log.cc:824] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:31.304450 22494 log.cc:824] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:31.304885 22493 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: No bootstrap required, opened a new log
I20260808 14:43:31.304957 22493 ts_tablet_manager.cc:1397] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:43:31.305158 22494 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: No bootstrap required, opened a new log
I20260808 14:43:31.305224 22494 ts_tablet_manager.cc:1397] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:43:31.306869 22493 raft_consensus.cc:348] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.307046 22493 raft_consensus.cc:374] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:31.307096 22493 raft_consensus.cc:729] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54329925f39e4f64ac9f5202b3bf1e3f, State: Initialized, Role: FOLLOWER
I20260808 14:43:31.307061 22494 raft_consensus.cc:348] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.307217 22494 raft_consensus.cc:374] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:43:31.307251 22494 raft_consensus.cc:729] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729c04333ec64978b0c8ce405814235c, State: Initialized, Role: FOLLOWER
I20260808 14:43:31.307214 22493 consensus_queue.cc:260] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.307358 22494 consensus_queue.cc:260] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.307510 22493 ts_tablet_manager.cc:1428] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:43:31.307510 22272 heartbeater.cc:503] Master 127.29.168.254:32777 was elected leader, sending a full tablet report...
I20260808 14:43:31.307708 22494 ts_tablet_manager.cc:1428] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:43:31.307761 22479 heartbeater.cc:503] Master 127.29.168.254:32777 was elected leader, sending a full tablet report...
I20260808 14:43:31.361792 22083 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:43:31.361919 22083 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.362267 22083 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
I20260808 14:43:31.365350 22079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.362422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:44485 (local address 127.29.168.193:38751)
0808 14:43:31.362490 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.362501 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.362549 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.362734 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.362735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.362737 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:31.362811 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.362812 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.363518 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.363519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.364491 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.364494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.365060 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.365061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.365147 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.365169 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.365225 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.365259 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":20}
I20260808 14:43:31.365357 22490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.362523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:38751 (local address 127.29.168.194:44485)
0808 14:43:31.362559 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.362560 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.362569 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:43:31.362615 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.362616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.362625 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.362686 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:31.362891 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.363422 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.364586 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.364984 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.365037 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.365044 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.365251 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.365295 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:43:31.365417 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.362489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:60823 (local address 127.29.168.195:39455)
0808 14:43:31.362528 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.362530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.362689 (+ 159us) server_negotiation.cc:407] Connection header received
0808 14:43:31.362749 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.362750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.362759 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.362811 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:43:31.363004 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.363469 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.364633 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.365053 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.365123 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.365132 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.365308 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.365344 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:43:31.365492 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.362422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:39455 (local address 127.29.168.193:60823)
0808 14:43:31.362617 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.362628 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:31.362685 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:31.362828 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:31.362828 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:31.362829 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:43:31.362918 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.362919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.363573 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.363574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.364528 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:31.364531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.365148 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.365149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:31.365221 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.365226 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:43:31.365290 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:43:31.365326 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":37,"thread_start_us":98,"threads_started":1}
I20260808 14:43:31.365727 22208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed6a02b202584126b806ed5a322703fc" candidate_uuid: "daca84376b4e4293b2ea2a62bff35132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" is_pre_election: true
I20260808 14:43:31.365757 22405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed6a02b202584126b806ed5a322703fc" candidate_uuid: "daca84376b4e4293b2ea2a62bff35132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729c04333ec64978b0c8ce405814235c" is_pre_election: true
I20260808 14:43:31.365901 22405 raft_consensus.cc:2454] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daca84376b4e4293b2ea2a62bff35132 in term 0.
I20260808 14:43:31.365903 22208 raft_consensus.cc:2454] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daca84376b4e4293b2ea2a62bff35132 in term 0.
I20260808 14:43:31.366160 21922 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729c04333ec64978b0c8ce405814235c, daca84376b4e4293b2ea2a62bff35132; no voters:
I20260808 14:43:31.366302 22083 raft_consensus.cc:2781] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:43:31.366374 22083 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:43:31.366393 22083 raft_consensus.cc:3037] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:31.367057 22083 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.367184 22083 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 1 election: Requested vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
I20260808 14:43:31.367333 22405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed6a02b202584126b806ed5a322703fc" candidate_uuid: "daca84376b4e4293b2ea2a62bff35132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729c04333ec64978b0c8ce405814235c"
I20260808 14:43:31.367358 22208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed6a02b202584126b806ed5a322703fc" candidate_uuid: "daca84376b4e4293b2ea2a62bff35132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54329925f39e4f64ac9f5202b3bf1e3f"
I20260808 14:43:31.367424 22405 raft_consensus.cc:3037] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:31.367425 22208 raft_consensus.cc:3037] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:43:31.368155 22405 raft_consensus.cc:2454] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daca84376b4e4293b2ea2a62bff35132 in term 1.
I20260808 14:43:31.368237 22208 raft_consensus.cc:2454] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daca84376b4e4293b2ea2a62bff35132 in term 1.
I20260808 14:43:31.368381 21922 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729c04333ec64978b0c8ce405814235c, daca84376b4e4293b2ea2a62bff35132; no voters:
I20260808 14:43:31.368480 22083 raft_consensus.cc:2781] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:43:31.368624 22083 raft_consensus.cc:686] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 LEADER]: Becoming Leader. State: Replica: daca84376b4e4293b2ea2a62bff35132, State: Running, Role: LEADER
I20260808 14:43:31.368705 22083 consensus_queue.cc:237] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:31.369397 21811 catalog_manager.cc:5495] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 reported cstate change: term changed from 0 to 1, leader changed from <none> to daca84376b4e4293b2ea2a62bff35132 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "daca84376b4e4293b2ea2a62bff35132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } health_report { overall_health: HEALTHY } } }
I20260808 14:43:31.391636 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.389640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36460 (local address 127.29.168.193:38307)
0808 14:43:31.389697 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:31.389699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:31.389724 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:43:31.389765 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:31.389765 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:31.389780 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:31.389830 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:43:31.389936 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.390374 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.391050 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:31.391214 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:31.391258 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:31.391375 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:43:31.391454 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:43:31.391501 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:31.391536 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 14:43:31.391551 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:43:31.392966 22405 raft_consensus.cc:1261] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Refusing update from remote peer daca84376b4e4293b2ea2a62bff35132: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:43:31.392990 22208 raft_consensus.cc:1261] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Refusing update from remote peer daca84376b4e4293b2ea2a62bff35132: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:43:31.393283 22507 consensus_queue.cc:1035] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:43:31.393412 22083 consensus_queue.cc:1035] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:43:31.395581 22277 tablet.cc:2369] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:43:31.396330 22513 mvcc.cc:205] Tried to move back new op lower bound from 7316276065863516160 to 7316276065766719488. Current Snapshot: MvccSnapshot[applied={T|T < 7316276065863516160 or (T in {7316276065863516160})}]
I20260808 14:43:31.396448 22515 mvcc.cc:205] Tried to move back new op lower bound from 7316276065863516160 to 7316276065766719488. Current Snapshot: MvccSnapshot[applied={T|T < 7316276065863516160}]
I20260808 14:43:31.397666 21810 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:43:31.397745 21810 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:43:31.398497 21810 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Sending DeleteTablet for 3 replicas of tablet ed6a02b202584126b806ed5a322703fc
I20260808 14:43:31.398844 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 21871
I20260808 14:43:31.398866 22376 tablet_service.cc:1514] Processing DeleteTablet for tablet ed6a02b202584126b806ed5a322703fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:43:31 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:33802
I20260808 14:43:31.398866 22175 tablet_service.cc:1514] Processing DeleteTablet for tablet ed6a02b202584126b806ed5a322703fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:43:31 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:59690
I20260808 14:43:31.403398 22525 tablet_replica.cc:330] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: stopping tablet replica
I20260808 14:43:31.403505 22525 raft_consensus.cc:2229] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:43:31.403609 22525 raft_consensus.cc:2258] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:43:31.404666 22525 ts_tablet_manager.cc:1905] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:43:31.405488 22527 tablet_replica.cc:330] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: stopping tablet replica
I20260808 14:43:31.405608 22527 raft_consensus.cc:2229] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:43:31.405727 22527 raft_consensus.cc:2258] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:43:31.406606 22525 ts_tablet_manager.cc:1918] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:43:31.406677 22525 log.cc:1196] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/ed6a02b202584126b806ed5a322703fc
I20260808 14:43:31.406913 22525 ts_tablet_manager.cc:1939] T ed6a02b202584126b806ed5a322703fc P 729c04333ec64978b0c8ce405814235c: Deleting consensus metadata
I20260808 14:43:31.408383 21796 catalog_manager.cc:4841] TS 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): tablet ed6a02b202584126b806ed5a322703fc (table test-table [id=64b66ec929ff48ca97464b50e69ddcd4]) successfully deleted
I20260808 14:43:31.409400 22527 ts_tablet_manager.cc:1905] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:43:31.411319 22527 ts_tablet_manager.cc:1918] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:43:31.411401 22527 log.cc:1196] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/ed6a02b202584126b806ed5a322703fc
I20260808 14:43:31.411728 22527 ts_tablet_manager.cc:1939] T ed6a02b202584126b806ed5a322703fc P 54329925f39e4f64ac9f5202b3bf1e3f: Deleting consensus metadata
I20260808 14:43:31.412168 21795 catalog_manager.cc:4841] TS 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): tablet ed6a02b202584126b806ed5a322703fc (table test-table [id=64b66ec929ff48ca97464b50e69ddcd4]) successfully deleted
W20260808 14:43:31.414315 21795 connection.cc:535] client connection to 127.29.168.193:38307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 14:43:31.414443 21795 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:43:31.414693 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 22084
I20260808 14:43:31.414880 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:31.414762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:38307 (local address 127.0.0.1:36464)
0808 14:43:31.414810 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:31.414844 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:43:31.416872 21795 catalog_manager.cc:4584] TS daca84376b4e4293b2ea2a62bff35132 (127.29.168.193:38307): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed6a02b202584126b806ed5a322703fc: Network error: Client connection negotiation failed: client connection to 127.29.168.193:38307: connect: Connection refused (error 111)
I20260808 14:43:31.428568 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 22282
I20260808 14:43:31.438862 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 21769
I20260808 14:43:51.447240 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:32777
--webserver_interface=127.29.168.254
--webserver_port=39665
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:32777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:51.529784 22530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:51.529973 22530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:51.529995 22530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:51.531116 22530 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:43:51.531153 22530 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:43:51.531167 22530 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:43:51.531208 22530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:43:51.531234 22530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:51.531265 22530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:51.531281 22530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:43:51.531303 22530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:43:51.532820 22530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:32777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:32777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:51.533083 22530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:51.533313 22530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:51.538410 22541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.538415 22538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.538424 22537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:51.538429 22530 server_base.cc:1034] running on GCE node
I20260808 14:43:51.538830 22530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:51.539177 22530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:51.542416 22530 hybrid_clock.cc:648] HybridClock initialized: now 1786200231542397 us; error 30 us; skew 500 ppm
Aug 08 14:43:51 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200231, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:51.548866 22530 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:43:51.549317 22530 webserver.cc:460] Webserver started at http://127.29.168.254:39665/ using document root <none> and password file <none>
I20260808 14:43:51.549538 22530 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:51.549605 22530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:51.550945 22530 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:51.551636 22549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.551872 22530 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:51.551970 22530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "3a6a86f23bc2484cafa6aa6525f52358"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "8b8c8bbd497e01ba2306331a05d6d4b7"
server_key_iv: "550bc70772789b23c28108db80c47921"
server_key_version: "encryptionkey@0"
I20260808 14:43:51.552332 22530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:51.562655 22530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:51.564625 22530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:51.564792 22530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:51.569021 22530 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:32777
I20260808 14:43:51.569062 22626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:32777 every 8 connection(s)
I20260808 14:43:51.569451 22530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:43:51.570904 22627 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:43:51.571580 22627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap starting.
I20260808 14:43:51.573401 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 22530
I20260808 14:43:51.573688 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:38307
--local_ip_for_outbound_sockets=127.29.168.193
--tserver_master_addrs=127.29.168.254:32777
--webserver_port=46821
--webserver_interface=127.29.168.193
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:43:51.581602 22627 log.cc:824] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:51.583959 22627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:43:51.584276 22627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Bootstrap complete.
I20260808 14:43:51.586815 22627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:51.587057 22627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6a86f23bc2484cafa6aa6525f52358, State: Initialized, Role: FOLLOWER
I20260808 14:43:51.587285 22627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:51.587385 22627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:43:51.587438 22627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:43:51.587486 22627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:43:51.588516 22627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:51.588634 22627 leader_election.cc:302] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a6a86f23bc2484cafa6aa6525f52358; no voters:
I20260808 14:43:51.588837 22627 leader_election.cc:288] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:43:51.588874 22633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:43:51.588994 22633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [term 3 LEADER]: Becoming Leader. State: Replica: 3a6a86f23bc2484cafa6aa6525f52358, State: Running, Role: LEADER
I20260808 14:43:51.589109 22627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:43:51.589141 22633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } }
I20260808 14:43:51.589440 22633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a6a86f23bc2484cafa6aa6525f52358. Latest consensus state: current_term: 3 leader_uuid: "3a6a86f23bc2484cafa6aa6525f52358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } } }
I20260808 14:43:51.589537 22633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: This master's current role is: LEADER
I20260808 14:43:51.589438 22634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3a6a86f23bc2484cafa6aa6525f52358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6a86f23bc2484cafa6aa6525f52358" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 32777 } } }
I20260808 14:43:51.589865 22634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358 [sys.catalog]: This master's current role is: LEADER
I20260808 14:43:51.589988 22640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:43:51.591077 22640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:43:51.591176 22640 catalog_manager.cc:1259] Loaded cluster ID: ac6cc5687abd430a8491146ffe87ca31
I20260808 14:43:51.591272 22640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:43:51.592773 22640 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:43:51.592983 22640 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Loaded TSK: 0
I20260808 14:43:51.593061 22640 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a6a86f23bc2484cafa6aa6525f52358: Loaded TSK: 1
F20260808 14:43:51.593386 22640 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff821b9c9ad google::LogMessage::Fail() at ??:0
@ 0x7ff821b9f88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff821b9c4de google::LogMessage::Flush() at ??:0
@ 0x7ff821b9da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff824309104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff824306d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff829af61cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff829af648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff829af6594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ff829abcc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff829ac6ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff823a6a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff823a5f954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff8248c36db start_thread at ??:0
@ 0x7ff82069a61f clone at ??:0
W20260808 14:43:51.672863 22630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:51.673100 22630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:51.673137 22630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:51.674258 22630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:51.674324 22630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:51.674366 22630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:43:51.675779 22630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:38307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=46821
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:51.676036 22630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:51.676270 22630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:51.681282 22676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.681329 22679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.681308 22677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:51.681912 22630 server_base.cc:1034] running on GCE node
I20260808 14:43:51.682142 22630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:51.682402 22630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:51.683583 22630 hybrid_clock.cc:648] HybridClock initialized: now 1786200231683561 us; error 48 us; skew 500 ppm
Aug 08 14:43:51 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200231, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:51.686192 22630 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:43:51.686719 22630 webserver.cc:460] Webserver started at http://127.29.168.193:46821/ using document root <none> and password file <none>
I20260808 14:43:51.686956 22630 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:51.687007 22630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:51.688490 22630 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:43:51.689306 22688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.689572 22630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:43:51.689690 22630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "daca84376b4e4293b2ea2a62bff35132"
format_stamp: "Formatted at 2026-08-08 14:43:09 on dist-test-slave-mjjr"
server_key: "0790bd73be1707a73ad599ea4acf5add"
server_key_iv: "027882da1da6b6abb132be4543fdb5c3"
server_key_version: "encryptionkey@0"
I20260808 14:43:51.690075 22630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:51.702641 22630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:51.704941 22630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:51.705108 22630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:51.705349 22630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:51.705796 22699 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:43:51.707739 22630 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:43:51.707798 22630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:43:51.707844 22630 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:43:51.708456 22630 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:43:51.708513 22630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:43:51.708591 22699 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Bootstrap starting.
I20260808 14:43:51.716504 22630 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:38307
I20260808 14:43:51.716933 22630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:43:51.717459 22846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:38307 every 8 connection(s)
I20260808 14:43:51.719805 22699 log.cc:824] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Log is configured to *not* fsync() on all Append() calls
I20260808 14:43:51.720145 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 22630
I20260808 14:43:51.720496 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:44485
--local_ip_for_outbound_sockets=127.29.168.194
--tserver_master_addrs=127.29.168.254:32777
--webserver_port=45137
--webserver_interface=127.29.168.194
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:43:51.722581 22699 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:43:51.722909 22699 tablet_bootstrap.cc:492] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Bootstrap complete.
I20260808 14:43:51.724179 22699 ts_tablet_manager.cc:1397] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.013s
I20260808 14:43:51.725534 22699 raft_consensus.cc:348] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:51.725841 22699 raft_consensus.cc:729] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: daca84376b4e4293b2ea2a62bff35132, State: Initialized, Role: FOLLOWER
I20260808 14:43:51.725999 22699 consensus_queue.cc:260] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:51.726267 22699 ts_tablet_manager.cc:1428] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260808 14:43:51.800688 22851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:43:51.717629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:43097)
0808 14:43:51.717813 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.717853 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:51.718323 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:51.800471 (+ 82148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":114,"threads_started":1}
W20260808 14:43:51.801007 22847 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:32777 (0 consecutive failures): Network error: Failed to ping master at 127.29.168.254:32777: Client connection negotiation failed: client connection to 127.29.168.254:32777: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:43:51.801434 22851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.801281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:49295)
0808 14:43:51.801343 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.801402 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:43:51.801816 22851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.801699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:47923)
0808 14:43:51.801752 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.801788 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 14:43:51.802003 22847 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:43:51.810482 22853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:51.810680 22853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:51.810705 22853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:51.811939 22853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:51.811981 22853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:51.812032 22853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:43:51.813464 22853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:44485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=45137
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:51.813740 22853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:51.813971 22853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:51.818943 22863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.818975 22865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.818987 22862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:51.819180 22853 server_base.cc:1034] running on GCE node
I20260808 14:43:51.819458 22853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:51.819809 22853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:51.820968 22853 hybrid_clock.cc:648] HybridClock initialized: now 1786200231820952 us; error 30 us; skew 500 ppm
Aug 08 14:43:51 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200231, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:51.823508 22853 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:43:51.823992 22853 webserver.cc:460] Webserver started at http://127.29.168.194:45137/ using document root <none> and password file <none>
I20260808 14:43:51.824182 22853 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:51.824234 22853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:51.825474 22853 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:43:51.826073 22873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.826275 22853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:43:51.826381 22853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "54329925f39e4f64ac9f5202b3bf1e3f"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "e5d3674f5dacbe691ac188f705ec7bae"
server_key_iv: "bdfdc9663023ca3331db42ea44c6a560"
server_key_version: "encryptionkey@0"
I20260808 14:43:51.826778 22853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:51.844152 22853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:51.846187 22853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:51.846351 22853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:51.846611 22853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:51.846971 22853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:51.847019 22853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.847044 22853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:51.847107 22853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.853528 22853 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:44485
I20260808 14:43:51.853582 23041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:44485 every 8 connection(s)
I20260808 14:43:51.853957 22853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:43:51.855059 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.854668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:35563)
0808 14:43:51.854843 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.854909 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
W20260808 14:43:51.855435 23042 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:32777 (0 consecutive failures): Network error: Failed to ping master at 127.29.168.254:32777: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
I20260808 14:43:51.855741 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.855605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:49219)
0808 14:43:51.855677 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.855706 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 14:43:51.856007 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.855920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:41861)
0808 14:43:51.855963 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.855985 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:43:51.856104 23042 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:43:51.857117 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 22853
I20260808 14:43:51.857367 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:39455
--local_ip_for_outbound_sockets=127.29.168.195
--tserver_master_addrs=127.29.168.254:32777
--webserver_port=44565
--webserver_interface=127.29.168.195
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:35835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:43:51.944868 23045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:43:51.945067 23045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:43:51.945091 23045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:43:51.946242 23045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:43:51.946292 23045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:43:51.946319 23045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:43:51.947935 23045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:39455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=44565
--tserver_master_addrs=127.29.168.254:32777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:43:51.948179 23045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:43:51.948454 23045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:43:51.953660 23051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.953656 23054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:43:51.953650 23052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:43:51.953733 23045 server_base.cc:1034] running on GCE node
I20260808 14:43:51.954073 23045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:43:51.954344 23045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:43:51.955508 23045 hybrid_clock.cc:648] HybridClock initialized: now 1786200231955507 us; error 38 us; skew 500 ppm
Aug 08 14:43:51 dist-test-slave-mjjr krb5kdc[20969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200231, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:43:51.958104 23045 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:43:51.958509 23045 webserver.cc:460] Webserver started at http://127.29.168.195:44565/ using document root <none> and password file <none>
I20260808 14:43:51.958752 23045 fs_manager.cc:359] Metadata directory not provided
I20260808 14:43:51.958839 23045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:43:51.960218 23045 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:43:51.960816 23064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.960991 23045 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.961102 23045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "729c04333ec64978b0c8ce405814235c"
format_stamp: "Formatted at 2026-08-08 14:43:10 on dist-test-slave-mjjr"
server_key: "210a25f0decc81c19c52ed2bb4d9eda3"
server_key_iv: "4ea45bf4533153eede18b539221b6f6b"
server_key_version: "encryptionkey@0"
I20260808 14:43:51.961424 23045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:43:51.980266 23045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:43:51.982682 23045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:43:51.982842 23045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:43:51.983098 23045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:43:51.983424 23045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:43:51.983477 23045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.983512 23045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:43:51.983559 23045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:43:51.989913 23045 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:39455
I20260808 14:43:51.989964 23232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:39455 every 8 connection(s)
I20260808 14:43:51.990316 23045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:43:51.991400 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.991010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:52883)
0808 14:43:51.991190 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.991261 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
W20260808 14:43:51.991889 23233 heartbeater.cc:644] Failed to heartbeat to 127.29.168.254:32777 (0 consecutive failures): Network error: Failed to ping master at 127.29.168.254:32777: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
I20260808 14:43:51.992223 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.992103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:42753)
0808 14:43:51.992151 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.992178 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:43:51.992578 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:51.992480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:37101)
0808 14:43:51.992534 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:51.992559 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 14:43:51.992709 23233 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:43:51.992981 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 23045
I20260808 14:43:52.802644 23237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.802396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:46973)
0808 14:43:52.802540 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:52.802575 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260808 14:43:52.856578 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.856368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:33397)
0808 14:43:52.856500 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:52.856533 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":52,"threads_started":1}
I20260808 14:43:52.889853 23239 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:43:52.889984 23239 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:52.890317 23239 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
Aug 08 14:43:52 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200231, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.194@KRBTEST.COM
Aug 08 14:43:52 dist-test-slave-mjjr krb5kdc[20969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200231, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.195@KRBTEST.COM
I20260808 14:43:52.902989 23242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.890635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:51955 (local address 127.29.168.195:39455)
0808 14:43:52.890790 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:52.890797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:52.890823 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:43:52.891432 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:52.891436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:52.891507 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:52.891683 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:52.892638 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.893990 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.895418 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.896087 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.896206 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:52.899284 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:52.899287 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:52.899288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:52.899299 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:52.901374 (+ 2075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:52.901812 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:52.901815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:52.901815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:52.901892 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:52.902167 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:52.902168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:52.902168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:52.902398 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:52.902490 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:52.902769 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 14:43:52.902890 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260808 14:43:52.902989 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.890484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:44485 (local address 127.29.168.193:60067)
0808 14:43:52.890732 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:52.890743 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:52.890813 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:52.891746 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:52.891749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:52.892222 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:52.892502 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:52.892509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.894100 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.894101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:52.895319 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:52.895322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.896197 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.896197 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:52.896358 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:52.896994 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:52.896997 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:52.898762 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:52.901253 (+ 2491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:52.901261 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:52.901263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:52.901686 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:52.901967 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:52.901968 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:52.901969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:52.902090 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:52.902472 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:52.902478 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:52.902598 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:43:52.902706 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:43:52.902891 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":71,"thread_start_us":73,"threads_started":1}
I20260808 14:43:52.903024 23241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.890585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:60067 (local address 127.29.168.194:44485)
0808 14:43:52.890770 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:43:52.890783 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:43:52.890823 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:43:52.891456 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:43:52.891459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:43:52.891507 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:43:52.891683 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:43:52.892620 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.893990 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.895418 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.896087 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.896206 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:52.898878 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:43:52.898881 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:43:52.898882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:43:52.898890 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:43:52.901150 (+ 2260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:52.901785 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:52.901788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:52.901788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:52.901893 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:43:52.902160 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:43:52.902161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:43:52.902161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:43:52.902396 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:43:52.902490 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:43:52.902759 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 14:43:52.902907 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260808 14:43:52.903103 23237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.890447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:39455 (local address 127.29.168.193:51955)
0808 14:43:52.890504 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:52.890515 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:43:52.890574 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:43:52.891746 (+ 1172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:43:52.891749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:43:52.892222 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:43:52.892502 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:52.892509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.894111 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.894112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:52.895319 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:43:52.895322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:43:52.896195 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:43:52.896196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:43:52.896358 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:43:52.896962 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:43:52.896972 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:43:52.899163 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:43:52.901449 (+ 2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:52.901450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:52.901451 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:52.901707 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:52.901978 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:43:52.901979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:43:52.901980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:43:52.902092 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:43:52.902471 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:43:52.902478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:43:52.902596 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 14:43:52.902706 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:43:52.902976 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":220}
W20260808 14:43:52.903849 22692 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
W20260808 14:43:52.904524 22693 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
I20260808 14:43:52.904608 22693 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: daca84376b4e4293b2ea2a62bff35132; no voters: 54329925f39e4f64ac9f5202b3bf1e3f, 729c04333ec64978b0c8ce405814235c
I20260808 14:43:52.904721 23239 raft_consensus.cc:2726] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:43:52.993264 23243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:52.993051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:44813)
0808 14:43:52.993186 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:52.993229 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260808 14:43:53.803429 23244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:53.803183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:56711)
0808 14:43:53.803349 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:53.803383 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":94,"threads_started":1}
I20260808 14:43:53.857146 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:53.856955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:46861)
0808 14:43:53.857077 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:53.857112 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":57,"threads_started":1}
I20260808 14:43:53.993885 23246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:53.993678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:37845)
0808 14:43:53.993813 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:53.993848 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260808 14:43:54.444373 23247 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:43:54.444463 23247 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:54.444694 23247 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
W20260808 14:43:54.445127 22693 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
W20260808 14:43:54.445218 22692 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
I20260808 14:43:54.445315 22692 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: daca84376b4e4293b2ea2a62bff35132; no voters: 54329925f39e4f64ac9f5202b3bf1e3f, 729c04333ec64978b0c8ce405814235c
I20260808 14:43:54.445393 23247 raft_consensus.cc:2726] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:43:54.804332 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:54.804107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:53781)
0808 14:43:54.804252 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:54.804285 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260808 14:43:54.857815 23250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:54.857583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:39781)
0808 14:43:54.857714 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:54.857775 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260808 14:43:54.994472 23253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:54.994298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:59643)
0808 14:43:54.994407 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:54.994439 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260808 14:43:55.805002 23254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:55.804793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:33479)
0808 14:43:55.804916 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:55.804952 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260808 14:43:55.858569 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:55.858253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:41483)
0808 14:43:55.858480 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:55.858514 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":73,"threads_started":1}
I20260808 14:43:55.995048 23256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:55.994862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:35289)
0808 14:43:55.994977 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:55.995012 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260808 14:43:56.805667 23257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:56.805460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:37223)
0808 14:43:56.805586 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:56.805620 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260808 14:43:56.859249 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:56.859062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:47513)
0808 14:43:56.859177 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:56.859212 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260808 14:43:56.995711 23259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:56.995486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:49273)
0808 14:43:56.995623 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:56.995674 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260808 14:43:57.447368 23261 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:43:57.447460 23261 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:43:57.447685 23261 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
W20260808 14:43:57.448096 22693 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
W20260808 14:43:57.448173 22692 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
I20260808 14:43:57.448227 22692 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: daca84376b4e4293b2ea2a62bff35132; no voters: 54329925f39e4f64ac9f5202b3bf1e3f, 729c04333ec64978b0c8ce405814235c
I20260808 14:43:57.448338 23261 raft_consensus.cc:2726] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:43:57.806377 23262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:57.806134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:44843)
0808 14:43:57.806287 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:57.806331 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260808 14:43:57.859965 23263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:57.859757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:60695)
0808 14:43:57.859883 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:57.859928 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260808 14:43:57.996282 23264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:57.996101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:48807)
0808 14:43:57.996218 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:57.996248 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
I20260808 14:43:58.807163 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:58.806918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:38791)
0808 14:43:58.807079 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:58.807116 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":115,"threads_started":1}
I20260808 14:43:58.860548 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:58.860344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:42755)
0808 14:43:58.860477 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:58.860512 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260808 14:43:58.996912 23269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:58.996686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:51553)
0808 14:43:58.996845 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:58.996877 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
I20260808 14:43:59.807927 23270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:59.807709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:42871)
0808 14:43:59.807848 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:59.807878 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260808 14:43:59.861104 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:59.860904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:43985)
0808 14:43:59.861035 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:59.861069 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":57,"threads_started":1}
I20260808 14:43:59.997555 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:43:59.997344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:50067)
0808 14:43:59.997476 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:43:59.997516 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260808 14:44:00.779075 23276 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:00.779208 23276 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:44:00.779517 23276 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
W20260808 14:44:00.779894 22693 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
W20260808 14:44:00.779956 22692 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
I20260808 14:44:00.779999 22692 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: daca84376b4e4293b2ea2a62bff35132; no voters: 54329925f39e4f64ac9f5202b3bf1e3f, 729c04333ec64978b0c8ce405814235c
I20260808 14:44:00.780084 23276 raft_consensus.cc:2726] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:44:00.808534 23278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:00.808336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:39937)
0808 14:44:00.808457 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:00.808490 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260808 14:44:00.861749 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:00.861528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:42789)
0808 14:44:00.861665 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:00.861696 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260808 14:44:00.998235 23281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:00.997990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:45787)
0808 14:44:00.998150 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:00.998184 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260808 14:44:01.809350 23282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:01.809108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:36705)
0808 14:44:01.809236 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:01.809265 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260808 14:44:01.862375 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:01.862194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:46577)
0808 14:44:01.862305 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:01.862336 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260808 14:44:01.998937 23284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:01.998715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:60379)
0808 14:44:01.998858 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:01.998894 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260808 14:44:02.809962 23285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:02.809723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:35349)
0808 14:44:02.809871 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:02.809910 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":59,"threads_started":1}
I20260808 14:44:02.862967 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:02.862763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:51443)
0808 14:44:02.862901 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:02.862931 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260808 14:44:02.999758 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:02.999484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:38891)
0808 14:44:02.999625 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:02.999713 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260808 14:44:03.810710 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:03.810484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:37575)
0808 14:44:03.810614 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:03.810650 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260808 14:44:03.863585 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:03.863375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:53231)
0808 14:44:03.863503 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:03.863548 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260808 14:44:04.000373 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:04.000172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:42397)
0808 14:44:04.000301 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:04.000332 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260808 14:44:04.811470 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:04.811245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:56621)
0808 14:44:04.811389 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:04.811423 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260808 14:44:04.851887 23298 raft_consensus.cc:482] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:04.851974 23298 raft_consensus.cc:504] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729c04333ec64978b0c8ce405814235c" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 39455 } } peers { permanent_uuid: "54329925f39e4f64ac9f5202b3bf1e3f" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 44485 } } peers { permanent_uuid: "daca84376b4e4293b2ea2a62bff35132" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 38307 } }
I20260808 14:44:04.852130 23298 leader_election.cc:288] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455), 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485)
W20260808 14:44:04.852528 22693 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 729c04333ec64978b0c8ce405814235c (127.29.168.195:39455): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
W20260808 14:44:04.852605 22692 leader_election.cc:341] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 54329925f39e4f64ac9f5202b3bf1e3f (127.29.168.194:44485): Not found: Tablet not found: ed6a02b202584126b806ed5a322703fc
I20260808 14:44:04.852646 22692 leader_election.cc:302] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: daca84376b4e4293b2ea2a62bff35132; no voters: 54329925f39e4f64ac9f5202b3bf1e3f, 729c04333ec64978b0c8ce405814235c
I20260808 14:44:04.852744 23298 raft_consensus.cc:2726] T ed6a02b202584126b806ed5a322703fc P daca84376b4e4293b2ea2a62bff35132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:44:04.864259 23299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:04.864046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:40345)
0808 14:44:04.864172 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:04.864212 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":51,"threads_started":1}
I20260808 14:44:05.000986 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:05.000784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:55395)
0808 14:44:05.000892 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:05.000925 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260808 14:44:05.812264 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:05.811994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:38297)
0808 14:44:05.812153 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:05.812191 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260808 14:44:05.865000 23306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:05.864713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:47389)
0808 14:44:05.864874 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:05.864922 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":77,"threads_started":1}
I20260808 14:44:06.001685 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:06.001479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:46417)
0808 14:44:06.001610 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:06.001645 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260808 14:44:06.812955 23308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:06.812771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.193:48631)
0808 14:44:06.812880 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:06.812910 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":55,"threads_started":1}
I20260808 14:44:06.865669 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:06.865483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.194:35857)
0808 14:44:06.865604 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:06.865635 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
I20260808 14:44:06.995285 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 22630
I20260808 14:44:07.003000 23310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:07.002294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:32777 (local address 127.29.168.195:33949)
0808 14:44:07.002904 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:07.002944 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.254:32777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":532,"threads_started":1}
I20260808 14:44:07.007717 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 22853
I20260808 14:44:07.018364 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 23045
2026-08-08T14:44:07Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58589 ms)
[----------] 30 tests from SecurityITest (231392 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:07 dist-test-slave-mjjr krb5kdc[23313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:07 dist-test-slave-mjjr krb5kdc[23313](info): set up 2 sockets
Aug 08 14:44:07 dist-test-slave-mjjr krb5kdc[23313](info): commencing operation
krb5kdc: starting...
W20260808 14:44:08.198868 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:08.309962 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45579
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:45579
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:08.387789 23328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:08.387957 23328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:08.387977 23328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:08.389057 23328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:08.389092 23328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:08.389106 23328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:08.389125 23328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:08.389137 23328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:08.390506 23328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:45579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:08.390686 23328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:08.390842 23328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:08.395543 23336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.395495 23337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.395530 23342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:08.395813 23328 server_base.cc:1034] running on GCE node
I20260808 14:44:08.396124 23328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:08.396445 23328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:08.397661 23328 hybrid_clock.cc:648] HybridClock initialized: now 1786200248397646 us; error 45 us; skew 500 ppm
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:08.399938 23328 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:08.400339 23328 webserver.cc:460] Webserver started at http://127.29.168.254:38345/ using document root <none> and password file <none>
I20260808 14:44:08.400550 23328 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:08.400593 23328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:08.400734 23328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:08.401762 23328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "32cf95ae87a0409ca90bb3e99da469e2"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "f9f16a1ba545ff5377ba1a3e4dc8ab41"
server_key_iv: "3f07de3550f06360c03b9f5fb24b9f10"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.402107 23328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "32cf95ae87a0409ca90bb3e99da469e2"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "f9f16a1ba545ff5377ba1a3e4dc8ab41"
server_key_iv: "3f07de3550f06360c03b9f5fb24b9f10"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.403439 23328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:08.404242 23353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.404412 23328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.404508 23328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "32cf95ae87a0409ca90bb3e99da469e2"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "f9f16a1ba545ff5377ba1a3e4dc8ab41"
server_key_iv: "3f07de3550f06360c03b9f5fb24b9f10"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.404593 23328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:08.414279 23328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:08.415928 23328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:08.416072 23328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:08.419595 23328 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:45579
I20260808 14:44:08.419626 23417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:45579 every 8 connection(s)
I20260808 14:44:08.419966 23328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:08.420814 23418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:08.422916 23418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2: Bootstrap starting.
I20260808 14:44:08.423496 23418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:08.423802 23418 log.cc:824] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:08.424507 23418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2: No bootstrap required, opened a new log
I20260808 14:44:08.424512 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 23328
I20260808 14:44:08.424636 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:08.424837 30371 external_mini_cluster.cc:1428] Setting key d3db40318f6fd5795d90301467e2816b
I20260808 14:44:08.427277 23418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32cf95ae87a0409ca90bb3e99da469e2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45579 } }
I20260808 14:44:08.427453 23418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:08.427567 23418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32cf95ae87a0409ca90bb3e99da469e2, State: Initialized, Role: FOLLOWER
I20260808 14:44:08.427770 23418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32cf95ae87a0409ca90bb3e99da469e2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45579 } }
I20260808 14:44:08.427863 23418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:08.427909 23418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:08.427963 23418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:08.428668 23418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32cf95ae87a0409ca90bb3e99da469e2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45579 } }
I20260808 14:44:08.428788 23418 leader_election.cc:302] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32cf95ae87a0409ca90bb3e99da469e2; no voters:
I20260808 14:44:08.428956 23418 leader_election.cc:288] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:08.429036 23425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:08.429190 23418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:08.429219 23425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [term 1 LEADER]: Becoming Leader. State: Replica: 32cf95ae87a0409ca90bb3e99da469e2, State: Running, Role: LEADER
I20260808 14:44:08.429430 23425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32cf95ae87a0409ca90bb3e99da469e2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45579 } }
I20260808 14:44:08.429813 23426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32cf95ae87a0409ca90bb3e99da469e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32cf95ae87a0409ca90bb3e99da469e2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45579 } } }
I20260808 14:44:08.429888 23426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:08.430097 23427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32cf95ae87a0409ca90bb3e99da469e2. Latest consensus state: current_term: 1 leader_uuid: "32cf95ae87a0409ca90bb3e99da469e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32cf95ae87a0409ca90bb3e99da469e2" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45579 } } }
I20260808 14:44:08.430428 23434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:08.431039 23434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:08.430203 23427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2 [sys.catalog]: This master's current role is: LEADER
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:08.437533 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.425341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46750 (local address 127.29.168.254:45579)
0808 14:44:08.425563 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.425573 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.425607 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:44:08.427219 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.427229 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.427293 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.427453 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:08.428256 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.429580 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.430711 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.431311 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.431428 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.434116 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:08.434121 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:08.434121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:08.434132 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:08.436020 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.436349 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.436352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.436352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.436454 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.436635 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.436636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.436636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.436948 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:08.437141 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.437215 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.437352 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260808 14:44:08.437680 23434 catalog_manager.cc:1347] Generated new cluster ID: b3acab140f3b4a609c0df218f10dc259
I20260808 14:44:08.437840 23434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:08.442469 23434 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:08.443141 23434 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:08.453265 23434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2: Generated new TSK 0
I20260808 14:44:08.453445 23434 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:44:08.483469 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45579
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:08.565650 23455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:08.565855 23455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:08.565876 23455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:08.567035 23455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:08.567075 23455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:08.567101 23455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:44:08.568634 23455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:08.568840 23455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:08.569057 23455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:08.573928 23464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.573956 23463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.573956 23467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:08.574321 23455 server_base.cc:1034] running on GCE node
I20260808 14:44:08.574573 23455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:08.574791 23455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:08.575942 23455 hybrid_clock.cc:648] HybridClock initialized: now 1786200248575936 us; error 53 us; skew 500 ppm
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:08.578513 23455 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:44:08.578974 23455 webserver.cc:460] Webserver started at http://127.29.168.193:38313/ using document root <none> and password file <none>
I20260808 14:44:08.579207 23455 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:08.579272 23455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:08.579421 23455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:08.580437 23455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "cfe22ce0cce24d468fcea32fdc25fc0a"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "00bcaf36a1ef5d1136dcdf5cc6cf71b1"
server_key_iv: "eb5c5108efebc8cf58aa8362fd35198e"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.580781 23455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "cfe22ce0cce24d468fcea32fdc25fc0a"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "00bcaf36a1ef5d1136dcdf5cc6cf71b1"
server_key_iv: "eb5c5108efebc8cf58aa8362fd35198e"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.582090 23455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:08.582777 23478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.582957 23455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:08.583069 23455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "cfe22ce0cce24d468fcea32fdc25fc0a"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "00bcaf36a1ef5d1136dcdf5cc6cf71b1"
server_key_iv: "eb5c5108efebc8cf58aa8362fd35198e"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.583148 23455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:08.598658 23455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:08.600777 23455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:08.600935 23455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:08.601143 23455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:08.601434 23455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:08.601488 23455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.601540 23455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:08.601569 23455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.607570 23455 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:44251
I20260808 14:44:08.607607 23630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:44251 every 8 connection(s)
I20260808 14:44:08.607995 23455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:44:08.608246 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 23455
I20260808 14:44:08.608356 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:08.608613 30371 external_mini_cluster.cc:1428] Setting key 2a96851c8bc5773b1cf6f576ece55b9b
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
I20260808 14:44:08.618021 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.608709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:42393 (local address 127.29.168.254:45579)
0808 14:44:08.608756 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.608758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.608940 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:44:08.609493 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.609495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.609508 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.609575 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:08.610427 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.611200 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.612725 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.612940 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.613014 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.615105 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:08.615106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:08.615107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:08.615114 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:08.616580 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.616989 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.616990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.616991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.617053 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.617349 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.617351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.617351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.617480 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:08.617554 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.617831 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.617931 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:44:08.618175 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.608644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45579 (local address 127.29.168.193:42393)
0808 14:44:08.608814 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:08.608852 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:08.609396 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:08.609630 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:08.609632 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:08.610158 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:08.610318 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.610322 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.611306 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.611307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.612642 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.612646 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.613023 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.613023 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.613154 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.613644 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:08.613652 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:08.615006 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:08.616670 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:08.616677 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:08.616679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:08.616898 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:08.617119 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:08.617120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:08.617121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:08.617269 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:08.617558 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:08.617566 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:08.617696 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 14:44:08.617796 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:44:08.617953 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260808 14:44:08.618624 23631 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45579
I20260808 14:44:08.618712 23631 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:08.618885 23631 heartbeater.cc:511] Master 127.29.168.254:45579 requested a full tablet report, sending...
I20260808 14:44:08.619407 23378 ts_manager.cc:194] Registered new tserver with Master: cfe22ce0cce24d468fcea32fdc25fc0a (127.29.168.193:44251)
I20260808 14:44:08.620064 23378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:42393
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:44:08.634305 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45579
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:08.713333 23637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:08.713522 23637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:08.713544 23637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:08.714599 23637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:08.714633 23637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:08.714659 23637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:44:08.716027 23637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:08.716202 23637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:08.716368 23637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:08.721298 23645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.721339 23650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.721344 23646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:08.721477 23637 server_base.cc:1034] running on GCE node
I20260808 14:44:08.721669 23637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:08.721951 23637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:08.723101 23637 hybrid_clock.cc:648] HybridClock initialized: now 1786200248723091 us; error 26 us; skew 500 ppm
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:08.725543 23637 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:44:08.725955 23637 webserver.cc:460] Webserver started at http://127.29.168.194:45559/ using document root <none> and password file <none>
I20260808 14:44:08.726184 23637 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:08.726248 23637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:08.726405 23637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:08.727422 23637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "08011c562952493f21038fa9033d0b44"
server_key_iv: "9cd4ae4684a6fa4d4117642dc88065ee"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.727824 23637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "08011c562952493f21038fa9033d0b44"
server_key_iv: "9cd4ae4684a6fa4d4117642dc88065ee"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.729230 23637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:08.729950 23662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.730120 23637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:08.730221 23637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "08011c562952493f21038fa9033d0b44"
server_key_iv: "9cd4ae4684a6fa4d4117642dc88065ee"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.730319 23637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:08.774175 23637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:08.776494 23637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:08.776659 23637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:08.776903 23637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:08.777213 23637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:08.777266 23637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.777307 23637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:08.777347 23637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.783166 23637 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:45191
I20260808 14:44:08.783213 23809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:45191 every 8 connection(s)
I20260808 14:44:08.783497 23637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:08.789480 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 23637
I20260808 14:44:08.789593 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:08.789780 30371 external_mini_cluster.cc:1428] Setting key 222b367c037863150b29a5832917216e
I20260808 14:44:08.792414 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.784189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:48941 (local address 127.29.168.254:45579)
0808 14:44:08.784252 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.784254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.784439 (+ 185us) server_negotiation.cc:407] Connection header received
0808 14:44:08.784923 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.784924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.784934 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.784991 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:08.785904 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.786356 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.787352 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.787535 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.787591 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.789472 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:08.789474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:08.789474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:08.789482 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:08.790896 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.791306 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.791307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.791308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.791394 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.791680 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.791681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.791681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.791796 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:08.791876 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.792257 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.792325 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:44:08.792522 23813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.784153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45579 (local address 127.29.168.194:48941)
0808 14:44:08.784323 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:08.784361 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:08.784844 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:08.785078 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:08.785081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:08.785580 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:08.785834 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.785839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.786428 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.786429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.787277 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.787279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.787610 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.787610 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.787781 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.788151 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:08.788157 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:08.789367 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:08.790989 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:08.790996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:08.790998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:08.791201 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:08.791462 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:08.791463 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:08.791464 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:08.791573 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:08.791881 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:08.791889 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:08.792017 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 14:44:08.792124 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:44:08.792282 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260808 14:44:08.792929 23810 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45579
I20260808 14:44:08.793025 23810 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:08.793196 23810 heartbeater.cc:511] Master 127.29.168.254:45579 requested a full tablet report, sending...
I20260808 14:44:08.793531 23378 ts_manager.cc:194] Registered new tserver with Master: c3266f516fb3442d8e9fd43dd1d9b9c2 (127.29.168.194:45191)
I20260808 14:44:08.793881 23378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:48941
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:44:08.814206 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45579
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:42931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:08.892297 23819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:08.892473 23819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:08.892495 23819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:08.893450 23819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:08.893481 23819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:08.893503 23819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:44:08.894778 23819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:42931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:08.894935 23819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:08.895080 23819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:08.899606 23829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.899624 23828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:08.899636 23832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:08.899861 23819 server_base.cc:1034] running on GCE node
I20260808 14:44:08.900038 23819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:08.900262 23819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:08.901425 23819 hybrid_clock.cc:648] HybridClock initialized: now 1786200248901409 us; error 29 us; skew 500 ppm
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:08.903827 23819 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:44:08.904304 23819 webserver.cc:460] Webserver started at http://127.29.168.195:44137/ using document root <none> and password file <none>
I20260808 14:44:08.904521 23819 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:08.904584 23819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:08.904713 23819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:08.905639 23819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "c8c2e6636637458d92f441ffa5c87dc9"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "daf35d73a168e29bf7317dc4e6d1aff5"
server_key_iv: "22c9fa5d7a08e2c0768e5ff1a89232b9"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.905983 23819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "c8c2e6636637458d92f441ffa5c87dc9"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "daf35d73a168e29bf7317dc4e6d1aff5"
server_key_iv: "22c9fa5d7a08e2c0768e5ff1a89232b9"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.907318 23819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:08.908115 23840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.908329 23819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:44:08.908434 23819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "c8c2e6636637458d92f441ffa5c87dc9"
format_stamp: "Formatted at 2026-08-08 14:44:08 on dist-test-slave-mjjr"
server_key: "daf35d73a168e29bf7317dc4e6d1aff5"
server_key_iv: "22c9fa5d7a08e2c0768e5ff1a89232b9"
server_key_version: "encryptionkey@0"
I20260808 14:44:08.908488 23819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:08.924098 23819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:08.925875 23819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:08.925981 23819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:08.926142 23819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:08.926445 23819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:08.926494 23819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.926535 23819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:08.926585 23819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:08.933460 23819 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:44887
I20260808 14:44:08.933511 24008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:44887 every 8 connection(s)
I20260808 14:44:08.933812 23819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:44:08.938876 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 23819
I20260808 14:44:08.938977 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:08.939170 30371 external_mini_cluster.cc:1428] Setting key f0d977598b42c8b1dd1b57eeccfb85df
Aug 08 14:44:08 dist-test-slave-mjjr krb5kdc[23313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200248, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:08.943136 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.934485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:44767 (local address 127.29.168.254:45579)
0808 14:44:08.934733 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.934735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.934845 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:44:08.935269 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.935270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.935280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.935347 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:08.936280 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.936751 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.937856 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.938015 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.938064 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.940559 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:08.940561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:08.940561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:08.940568 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:08.942102 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.942456 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.942457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.942457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.942517 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.942691 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.942692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.942692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.942773 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:08.942838 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.943023 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.943076 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:44:08.943297 24017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.934447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45579 (local address 127.29.168.195:44767)
0808 14:44:08.934732 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:08.934772 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:08.935189 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:08.935390 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:08.935392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:08.936023 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:08.936205 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.936209 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.936826 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.936826 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.937787 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.937789 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.938084 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.938085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.938171 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.938670 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:08.938678 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:08.940417 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:08.942175 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:08.942181 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:08.942183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:08.942390 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:08.942566 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:08.942566 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:08.942566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:08.942649 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:08.942823 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:08.942827 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:08.942917 (+ 90us) client_negotiation.cc:769] Sending connection context
0808 14:44:08.943012 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:44:08.943116 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":207,"threads_started":1}
I20260808 14:44:08.943758 24013 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45579
I20260808 14:44:08.943841 24013 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:08.943966 24013 heartbeater.cc:511] Master 127.29.168.254:45579 requested a full tablet report, sending...
I20260808 14:44:08.944324 23378 ts_manager.cc:194] Registered new tserver with Master: c8c2e6636637458d92f441ffa5c87dc9 (127.29.168.195:44887)
I20260808 14:44:08.944645 23378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:44767
I20260808 14:44:08.950906 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:08.957242 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.952271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46762 (local address 127.29.168.254:45579)
0808 14:44:08.952310 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.952312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.952445 (+ 133us) server_negotiation.cc:407] Connection header received
0808 14:44:08.952503 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.952504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.952512 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.952567 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:08.953009 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.953540 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.954142 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.954287 (+ 145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.954339 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.955294 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:08.955295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:08.955295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:08.955300 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:08.956341 (+ 1041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.956631 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.956632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.956632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.956676 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:08.956825 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:08.956826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:08.956826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:08.956935 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:08.957001 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.957096 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.957147 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:08.958636 23378 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:08.960217 23378 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:08.966576 24031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.962640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.29.168.193:44251)
0808 14:44:08.962827 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.962831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.962999 (+ 168us) server_negotiation.cc:407] Connection header received
0808 14:44:08.963056 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.963058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.963073 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.963173 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:08.963287 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.964365 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.965521 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.966146 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.966221 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.966268 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.966421 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.966462 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":77,"threads_started":1}
I20260808 14:44:08.966566 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.962451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:44251 (local address 127.0.0.1:45764)
0808 14:44:08.962877 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:08.962887 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:08.962944 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:08.963180 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:08.963181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:08.963183 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:08.963228 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.963230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.964477 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.964478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.965440 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.965442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.966236 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.966237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.966313 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.966325 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:44:08.966393 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:44:08.966459 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":29,"thread_start_us":95,"threads_started":1}
I20260808 14:44:08.966760 24032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.962720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41878 (local address 127.29.168.194:45191)
0808 14:44:08.962912 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.962915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.963361 (+ 446us) server_negotiation.cc:407] Connection header received
0808 14:44:08.963411 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.963413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.963429 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.963498 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:08.963609 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.964367 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.965764 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.966234 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.966299 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.966348 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.966613 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.966661 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":74,"threads_started":1}
I20260808 14:44:08.966794 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.962442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44887 (local address 127.0.0.1:37672)
0808 14:44:08.962619 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:08.962657 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:08.962721 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:08.962927 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:08.962929 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:08.962932 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:08.962990 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.962992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.964322 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.964324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.965667 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.965670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.966544 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.966546 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.966630 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.966634 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:08.966691 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:44:08.966731 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":59,"thread_start_us":46,"threads_started":1}
I20260808 14:44:08.967021 24030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.962612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37672 (local address 127.29.168.195:44887)
0808 14:44:08.962772 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:08.962776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:08.962786 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:08.962817 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:08.962819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:08.962839 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:08.962921 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:08.963072 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.964213 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.965747 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.966357 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.966435 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.966490 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:08.966880 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 14:44:08.966920 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":78,"threads_started":1}
I20260808 14:44:08.967255 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:08.962454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:45191 (local address 127.0.0.1:41878)
0808 14:44:08.963014 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:08.963023 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:08.963070 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:08.963506 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:08.963507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:08.963509 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:08.963550 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.963552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.964483 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.964484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.965667 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:08.965670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:08.966378 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:08.966379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:08.966425 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:08.966428 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:08.966485 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:44:08.966535 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":25,"thread_start_us":100,"threads_started":1}
I20260808 14:44:08.967721 23922 tablet_service.cc:1467] Processing CreateTablet for tablet a73aa4f0d79d48b3a74c5bf7c8da628a (DEFAULT_TABLE table=test-table [id=65302a63e11644628d7b6d9cd533ee38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:08.967720 23544 tablet_service.cc:1467] Processing CreateTablet for tablet a73aa4f0d79d48b3a74c5bf7c8da628a (DEFAULT_TABLE table=test-table [id=65302a63e11644628d7b6d9cd533ee38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:08.968019 23922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73aa4f0d79d48b3a74c5bf7c8da628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:08.968076 23544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73aa4f0d79d48b3a74c5bf7c8da628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:08.968034 23728 tablet_service.cc:1467] Processing CreateTablet for tablet a73aa4f0d79d48b3a74c5bf7c8da628a (DEFAULT_TABLE table=test-table [id=65302a63e11644628d7b6d9cd533ee38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:08.968327 23728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73aa4f0d79d48b3a74c5bf7c8da628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:08.970489 24034 tablet_bootstrap.cc:492] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Bootstrap starting.
I20260808 14:44:08.971084 24034 tablet_bootstrap.cc:654] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:08.971347 24036 tablet_bootstrap.cc:492] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a: Bootstrap starting.
I20260808 14:44:08.971725 24034 log.cc:824] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:08.971803 24037 tablet_bootstrap.cc:492] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Bootstrap starting.
I20260808 14:44:08.972077 24036 tablet_bootstrap.cc:654] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:08.972450 24037 tablet_bootstrap.cc:654] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:08.972646 24036 log.cc:824] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:08.972702 24034 tablet_bootstrap.cc:492] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: No bootstrap required, opened a new log
I20260808 14:44:08.972755 24034 ts_tablet_manager.cc:1397] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:44:08.973011 24037 log.cc:824] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:08.973415 24036 tablet_bootstrap.cc:492] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a: No bootstrap required, opened a new log
I20260808 14:44:08.973480 24036 ts_tablet_manager.cc:1397] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:44:08.973662 24037 tablet_bootstrap.cc:492] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: No bootstrap required, opened a new log
I20260808 14:44:08.973750 24037 ts_tablet_manager.cc:1397] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:08.974655 24034 raft_consensus.cc:348] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:08.974829 24034 raft_consensus.cc:374] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:08.974865 24034 raft_consensus.cc:729] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c2e6636637458d92f441ffa5c87dc9, State: Initialized, Role: FOLLOWER
I20260808 14:44:08.974994 24034 consensus_queue.cc:260] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:08.975260 24034 ts_tablet_manager.cc:1428] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:44:08.975281 24013 heartbeater.cc:503] Master 127.29.168.254:45579 was elected leader, sending a full tablet report...
I20260808 14:44:08.975164 24037 raft_consensus.cc:348] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:08.975324 24037 raft_consensus.cc:374] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:08.975356 24037 raft_consensus.cc:729] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3266f516fb3442d8e9fd43dd1d9b9c2, State: Initialized, Role: FOLLOWER
I20260808 14:44:08.975456 24037 consensus_queue.cc:260] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:08.975745 24037 ts_tablet_manager.cc:1428] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:08.975764 24036 raft_consensus.cc:348] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:08.975893 23810 heartbeater.cc:503] Master 127.29.168.254:45579 was elected leader, sending a full tablet report...
I20260808 14:44:08.975926 24036 raft_consensus.cc:374] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:08.975966 24036 raft_consensus.cc:729] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe22ce0cce24d468fcea32fdc25fc0a, State: Initialized, Role: FOLLOWER
I20260808 14:44:08.976083 24036 consensus_queue.cc:260] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:08.976333 24036 ts_tablet_manager.cc:1428] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:44:08.976454 23631 heartbeater.cc:503] Master 127.29.168.254:45579 was elected leader, sending a full tablet report...
I20260808 14:44:09.011219 24042 raft_consensus.cc:482] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:09.011329 24042 raft_consensus.cc:504] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:09.011735 24042 leader_election.cc:288] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfe22ce0cce24d468fcea32fdc25fc0a (127.29.168.193:44251), c3266f516fb3442d8e9fd43dd1d9b9c2 (127.29.168.194:45191)
I20260808 14:44:09.014269 24017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.011880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:45191 (local address 127.29.168.195:51087)
0808 14:44:09.011919 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.011930 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.011968 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.012144 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.012146 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.012148 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:09.012210 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.012213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.012833 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.012834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.013512 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.013514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.014030 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.014031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.014104 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.014107 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.014174 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.014209 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 14:44:09.014268 24032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.011948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:51087 (local address 127.29.168.194:45191)
0808 14:44:09.012007 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.012009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.012017 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:09.012040 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.012041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.012057 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.012125 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:09.012288 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.012755 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.013612 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.013952 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.014031 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.014040 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.014180 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.014210 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:44:09.014472 24031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.011954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:53483 (local address 127.29.168.193:44251)
0808 14:44:09.012003 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.012005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.012134 (+ 129us) server_negotiation.cc:407] Connection header received
0808 14:44:09.012189 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.012191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.012200 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.012251 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:09.012417 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.012875 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.013746 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.014093 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.014171 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.014179 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.014347 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.014392 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:44:09.014598 23756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73aa4f0d79d48b3a74c5bf7c8da628a" candidate_uuid: "c8c2e6636637458d92f441ffa5c87dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" is_pre_election: true
I20260808 14:44:09.014678 24047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.011880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:44251 (local address 127.29.168.195:53483)
0808 14:44:09.012081 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.012089 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.012139 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.012251 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.012251 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.012253 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:09.012331 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.012332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.012953 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.012954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.013661 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.013662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.014174 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.014175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.014239 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.014243 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.014556 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.014609 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":46,"thread_start_us":104,"threads_started":1}
I20260808 14:44:09.014724 23756 raft_consensus.cc:2454] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c2e6636637458d92f441ffa5c87dc9 in term 0.
I20260808 14:44:09.014953 23842 leader_election.cc:302] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3266f516fb3442d8e9fd43dd1d9b9c2, c8c2e6636637458d92f441ffa5c87dc9; no voters:
I20260808 14:44:09.014945 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73aa4f0d79d48b3a74c5bf7c8da628a" candidate_uuid: "c8c2e6636637458d92f441ffa5c87dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" is_pre_election: true
I20260808 14:44:09.015065 23571 raft_consensus.cc:2454] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c2e6636637458d92f441ffa5c87dc9 in term 0.
I20260808 14:44:09.015058 24042 raft_consensus.cc:2781] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:44:09.015120 24042 raft_consensus.cc:482] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:44:09.015143 24042 raft_consensus.cc:3037] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:09.015789 24042 raft_consensus.cc:504] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:09.015928 24042 leader_election.cc:288] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [CANDIDATE]: Term 1 election: Requested vote from peers cfe22ce0cce24d468fcea32fdc25fc0a (127.29.168.193:44251), c3266f516fb3442d8e9fd43dd1d9b9c2 (127.29.168.194:45191)
I20260808 14:44:09.016083 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73aa4f0d79d48b3a74c5bf7c8da628a" candidate_uuid: "c8c2e6636637458d92f441ffa5c87dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a"
I20260808 14:44:09.016083 23756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73aa4f0d79d48b3a74c5bf7c8da628a" candidate_uuid: "c8c2e6636637458d92f441ffa5c87dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2"
I20260808 14:44:09.016155 23756 raft_consensus.cc:3037] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:09.016155 23571 raft_consensus.cc:3037] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:09.016978 23571 raft_consensus.cc:2454] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c2e6636637458d92f441ffa5c87dc9 in term 1.
I20260808 14:44:09.016986 23756 raft_consensus.cc:2454] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c2e6636637458d92f441ffa5c87dc9 in term 1.
I20260808 14:44:09.017151 23842 leader_election.cc:302] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3266f516fb3442d8e9fd43dd1d9b9c2, c8c2e6636637458d92f441ffa5c87dc9; no voters:
I20260808 14:44:09.017259 24042 raft_consensus.cc:2781] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:09.017426 24042 raft_consensus.cc:686] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 1 LEADER]: Becoming Leader. State: Replica: c8c2e6636637458d92f441ffa5c87dc9, State: Running, Role: LEADER
I20260808 14:44:09.017520 24042 consensus_queue.cc:237] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } }
I20260808 14:44:09.018230 23376 catalog_manager.cc:5495] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c2e6636637458d92f441ffa5c87dc9 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "c8c2e6636637458d92f441ffa5c87dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c2e6636637458d92f441ffa5c87dc9" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260808 14:44:09.023104 24030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.020931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37686 (local address 127.29.168.195:44887)
0808 14:44:09.020976 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.020978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.020987 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:44:09.021061 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.021062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.021077 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.021139 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:09.021323 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.021793 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.022479 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.022656 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.022701 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.022827 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:09.022903 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:09.022958 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.022989 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.023003 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:44:09.024542 23571 raft_consensus.cc:1261] T a73aa4f0d79d48b3a74c5bf7c8da628a P cfe22ce0cce24d468fcea32fdc25fc0a [term 1 FOLLOWER]: Refusing update from remote peer c8c2e6636637458d92f441ffa5c87dc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:09.024556 23756 raft_consensus.cc:1261] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 1 FOLLOWER]: Refusing update from remote peer c8c2e6636637458d92f441ffa5c87dc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:09.024868 24042 consensus_queue.cc:1035] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3266f516fb3442d8e9fd43dd1d9b9c2" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:09.024996 24048 consensus_queue.cc:1035] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfe22ce0cce24d468fcea32fdc25fc0a" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:09.027406 24053 mvcc.cc:205] Tried to move back new op lower bound from 7316276220002537472 to 7316276219976409088. Current Snapshot: MvccSnapshot[applied={T|T < 7316276220002537472}]
I20260808 14:44:09.027472 24051 mvcc.cc:205] Tried to move back new op lower bound from 7316276220002537472 to 7316276219976409088. Current Snapshot: MvccSnapshot[applied={T|T < 7316276220002537472}]
I20260808 14:44:09.029702 23378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:09.029785 23378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:09.030539 23378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32cf95ae87a0409ca90bb3e99da469e2: Sending DeleteTablet for 3 replicas of tablet a73aa4f0d79d48b3a74c5bf7c8da628a
I20260808 14:44:09.030892 23922 tablet_service.cc:1514] Processing DeleteTablet for tablet a73aa4f0d79d48b3a74c5bf7c8da628a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:09 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:37672
I20260808 14:44:09.030890 23728 tablet_service.cc:1514] Processing DeleteTablet for tablet a73aa4f0d79d48b3a74c5bf7c8da628a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:09 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:41878
I20260808 14:44:09.030951 23544 tablet_service.cc:1514] Processing DeleteTablet for tablet a73aa4f0d79d48b3a74c5bf7c8da628a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:09 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:45764
I20260808 14:44:09.031114 24063 tablet_replica.cc:330] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: stopping tablet replica
I20260808 14:44:09.031224 24063 raft_consensus.cc:2229] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:09.031330 24063 raft_consensus.cc:2258] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:09.031491 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 23455
I20260808 14:44:09.032464 24063 ts_tablet_manager.cc:1905] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:09.034579 24063 ts_tablet_manager.cc:1918] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:09.034674 24063 log.cc:1196] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/a73aa4f0d79d48b3a74c5bf7c8da628a
I20260808 14:44:09.035017 24063 ts_tablet_manager.cc:1939] T a73aa4f0d79d48b3a74c5bf7c8da628a P c3266f516fb3442d8e9fd43dd1d9b9c2: Deleting consensus metadata
I20260808 14:44:09.035460 23356 catalog_manager.cc:4841] TS c3266f516fb3442d8e9fd43dd1d9b9c2 (127.29.168.194:45191): tablet a73aa4f0d79d48b3a74c5bf7c8da628a (table test-table [id=65302a63e11644628d7b6d9cd533ee38]) successfully deleted
I20260808 14:44:09.038255 24064 tablet_replica.cc:330] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: stopping tablet replica
I20260808 14:44:09.038395 24064 raft_consensus.cc:2229] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:44:09.038563 24064 raft_consensus.cc:2258] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:09.039685 24064 ts_tablet_manager.cc:1905] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:09.041107 24064 ts_tablet_manager.cc:1918] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:09.041178 24064 log.cc:1196] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/a73aa4f0d79d48b3a74c5bf7c8da628a
I20260808 14:44:09.041474 24064 ts_tablet_manager.cc:1939] T a73aa4f0d79d48b3a74c5bf7c8da628a P c8c2e6636637458d92f441ffa5c87dc9: Deleting consensus metadata
I20260808 14:44:09.041868 23357 catalog_manager.cc:4841] TS c8c2e6636637458d92f441ffa5c87dc9 (127.29.168.195:44887): tablet a73aa4f0d79d48b3a74c5bf7c8da628a (table test-table [id=65302a63e11644628d7b6d9cd533ee38]) successfully deleted
W20260808 14:44:09.046913 23358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:44251 (error 108)
I20260808 14:44:09.047237 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 23637
I20260808 14:44:09.047456 24028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.047320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:44251 (local address 127.0.0.1:45768)
0808 14:44:09.047374 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.047412 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:44251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 14:44:09.047575 23358 catalog_manager.cc:4584] TS cfe22ce0cce24d468fcea32fdc25fc0a (127.29.168.193:44251): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a73aa4f0d79d48b3a74c5bf7c8da628a: Network error: Client connection negotiation failed: client connection to 127.29.168.193:44251: connect: Connection refused (error 111)
I20260808 14:44:09.057734 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 23819
I20260808 14:44:09.069669 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 23328
2026-08-08T14:44:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2049 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T14:44:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:09Z Disabled control of system clock
I20260808 14:44:09.101267 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37565
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:09.178923 24072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:09.179101 24072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:09.179119 24072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:09.180158 24072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:09.180194 24072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:09.180207 24072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:09.180218 24072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:09.180253 24072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:09.181595 24072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:09.181839 24072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:09.182133 24072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:09.186679 24081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.186681 24079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.186728 24083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:09.186836 24072 server_base.cc:1034] running on GCE node
I20260808 14:44:09.187095 24072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:09.187367 24072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:09.188508 24072 hybrid_clock.cc:648] HybridClock initialized: now 1786200249188493 us; error 36 us; skew 500 ppm
I20260808 14:44:09.189625 24072 webserver.cc:460] Webserver started at http://127.29.168.254:34031/ using document root <none> and password file <none>
I20260808 14:44:09.189853 24072 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:09.189893 24072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:09.190042 24072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:09.190958 24072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "77bc2eb95f8848c8834c9aed9acce87b"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "92b0c9d69189d9dea3a3d38e76dc1ee1"
server_key_iv: "a41f58aaef1062ea05b2449f12845520"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.191286 24072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "77bc2eb95f8848c8834c9aed9acce87b"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "92b0c9d69189d9dea3a3d38e76dc1ee1"
server_key_iv: "a41f58aaef1062ea05b2449f12845520"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.192642 24072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:09.193305 24092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.193499 24072 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:09.193581 24072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "77bc2eb95f8848c8834c9aed9acce87b"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "92b0c9d69189d9dea3a3d38e76dc1ee1"
server_key_iv: "a41f58aaef1062ea05b2449f12845520"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.193642 24072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:09.214932 24072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:09.215121 24072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:09.215205 24072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:09.218849 24072 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:37565
I20260808 14:44:09.218924 24164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:37565 every 8 connection(s)
I20260808 14:44:09.219198 24072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:09.220155 24168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:09.222288 24168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b: Bootstrap starting.
I20260808 14:44:09.222885 24168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:09.223169 24168 log.cc:824] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:09.223819 24168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b: No bootstrap required, opened a new log
I20260808 14:44:09.225330 24168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77bc2eb95f8848c8834c9aed9acce87b" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37565 } }
I20260808 14:44:09.225495 24168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:09.225569 24168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77bc2eb95f8848c8834c9aed9acce87b, State: Initialized, Role: FOLLOWER
I20260808 14:44:09.225692 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 24072
I20260808 14:44:09.225729 24168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77bc2eb95f8848c8834c9aed9acce87b" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37565 } }
I20260808 14:44:09.225816 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:09.225842 24168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:09.225876 24168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:09.225920 24168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:09.226052 30371 external_mini_cluster.cc:1428] Setting key b89ae3fcbba3f3f48989f9a45cf634cb
I20260808 14:44:09.226620 24168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77bc2eb95f8848c8834c9aed9acce87b" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37565 } }
I20260808 14:44:09.226748 24168 leader_election.cc:302] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77bc2eb95f8848c8834c9aed9acce87b; no voters:
I20260808 14:44:09.226917 24168 leader_election.cc:288] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:09.226963 24176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:09.227110 24176 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [term 1 LEADER]: Becoming Leader. State: Replica: 77bc2eb95f8848c8834c9aed9acce87b, State: Running, Role: LEADER
I20260808 14:44:09.227294 24176 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77bc2eb95f8848c8834c9aed9acce87b" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37565 } }
I20260808 14:44:09.227622 24176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77bc2eb95f8848c8834c9aed9acce87b. Latest consensus state: current_term: 1 leader_uuid: "77bc2eb95f8848c8834c9aed9acce87b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77bc2eb95f8848c8834c9aed9acce87b" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37565 } } }
I20260808 14:44:09.227655 24178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77bc2eb95f8848c8834c9aed9acce87b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77bc2eb95f8848c8834c9aed9acce87b" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37565 } } }
I20260808 14:44:09.227147 24168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:09.227768 24176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:09.227834 24178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:09.228327 24181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:09.228837 24181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:09.230258 24181 catalog_manager.cc:1347] Generated new cluster ID: c535600a77fd47afbf0f14d63262ccfa
I20260808 14:44:09.230322 24181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:09.232062 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.226565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45794 (local address 127.29.168.254:37565)
0808 14:44:09.226870 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.226881 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.226913 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:44:09.227027 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.227033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.227107 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.227246 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:09.227477 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.229139 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.230063 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.230595 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.230693 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.231321 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:09.231324 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:09.231325 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:09.231547 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:09.231586 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:09.231598 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:09.231674 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.231782 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.231860 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":135,"threads_started":1}
I20260808 14:44:09.250913 24181 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:09.251398 24181 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:09.259703 24181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b: Generated new TSK 0
I20260808 14:44:09.259867 24181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:09.261704 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37565
--builtin_ntp_servers=127.29.168.212:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:09.342090 24204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:09.342309 24204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:09.342346 24204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:09.343421 24204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:09.343478 24204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:09.343518 24204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:44:09.344765 24204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:09.344995 24204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:09.345252 24204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:44:09.350121 24204 server_base.cc:1034] running on GCE node
W20260808 14:44:09.350126 24212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.350163 24209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.350235 24210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:09.350492 24204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:09.350693 24204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:09.351841 24204 hybrid_clock.cc:648] HybridClock initialized: now 1786200249351822 us; error 39 us; skew 500 ppm
I20260808 14:44:09.353091 24204 webserver.cc:460] Webserver started at http://127.29.168.193:44783/ using document root <none> and password file <none>
I20260808 14:44:09.353353 24204 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:09.353423 24204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:09.353580 24204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:09.354571 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "23a3fa2eaef14a7690fde91b1158a063"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "5f25a04fdc723381a014507080c0e49f"
server_key_iv: "cda2d52ca1e79b45f0bd51171709541d"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.354969 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "23a3fa2eaef14a7690fde91b1158a063"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "5f25a04fdc723381a014507080c0e49f"
server_key_iv: "cda2d52ca1e79b45f0bd51171709541d"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.356346 24204 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:09.357043 24224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.357214 24204 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:09.357321 24204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "23a3fa2eaef14a7690fde91b1158a063"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "5f25a04fdc723381a014507080c0e49f"
server_key_iv: "cda2d52ca1e79b45f0bd51171709541d"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.357393 24204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:09.370267 24204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:09.370524 24204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:09.370651 24204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:09.370831 24204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:09.371100 24204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:09.371166 24204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.371217 24204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:09.371240 24204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.376925 24204 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:45583
I20260808 14:44:09.376973 24378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:45583 every 8 connection(s)
I20260808 14:44:09.377310 24204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:44:09.381986 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.377945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:56331 (local address 127.29.168.254:37565)
0808 14:44:09.378021 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.378024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.378221 (+ 197us) server_negotiation.cc:407] Connection header received
0808 14:44:09.378626 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.378627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.378639 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.378689 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:09.379320 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.379824 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.380740 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.380931 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.380979 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.381765 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:09.381766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:09.381766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:09.381772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:09.381783 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:09.381786 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:09.381831 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.381910 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.381932 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:44:09.382205 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.377922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37565 (local address 127.29.168.193:56331)
0808 14:44:09.378119 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.378147 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.378553 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.378749 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.378752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.378759 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:09.379201 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.379205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.379907 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.379908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.380671 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.380673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.381004 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.381005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.381109 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.381636 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:09.381636 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:09.381671 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:09.381691 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:09.381843 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:09.381848 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:09.381850 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.381900 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.381971 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":99,"threads_started":1}
I20260808 14:44:09.382720 24380 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37565
I20260808 14:44:09.382827 24380 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:09.382995 24380 heartbeater.cc:511] Master 127.29.168.254:37565 requested a full tablet report, sending...
I20260808 14:44:09.383497 24116 ts_manager.cc:194] Registered new tserver with Master: 23a3fa2eaef14a7690fde91b1158a063 (127.29.168.193:45583)
I20260808 14:44:09.384107 24116 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.193:56331
I20260808 14:44:09.387143 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 24204
I20260808 14:44:09.387233 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:09.387405 30371 external_mini_cluster.cc:1428] Setting key 750f8a65f65819ab8a3e7a5aaaeaceb5
I20260808 14:44:09.388298 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37565
--builtin_ntp_servers=127.29.168.212:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:09.468019 24386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:09.468195 24386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:09.468215 24386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:09.469200 24386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:09.469229 24386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:09.469257 24386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:44:09.470408 24386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:09.470561 24386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:09.470758 24386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:09.475425 24395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.475440 24394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.475440 24397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:09.475600 24386 server_base.cc:1034] running on GCE node
I20260808 14:44:09.475857 24386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:09.476097 24386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:09.477231 24386 hybrid_clock.cc:648] HybridClock initialized: now 1786200249477210 us; error 42 us; skew 500 ppm
I20260808 14:44:09.478508 24386 webserver.cc:460] Webserver started at http://127.29.168.194:34315/ using document root <none> and password file <none>
I20260808 14:44:09.478749 24386 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:09.478797 24386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:09.478957 24386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:09.479976 24386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "8b73d58429d8499e89fde164c6618f1b"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "c98eda710c312d176664a88d0b82b605"
server_key_iv: "6b1c84bedc3fe51eda904a05ce09fbf3"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.480331 24386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "8b73d58429d8499e89fde164c6618f1b"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "c98eda710c312d176664a88d0b82b605"
server_key_iv: "6b1c84bedc3fe51eda904a05ce09fbf3"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.481612 24386 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:09.482270 24405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.482443 24386 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:09.482539 24386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "8b73d58429d8499e89fde164c6618f1b"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "c98eda710c312d176664a88d0b82b605"
server_key_iv: "6b1c84bedc3fe51eda904a05ce09fbf3"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.482630 24386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:09.495748 24386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:09.495986 24386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:09.496162 24386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:09.496441 24386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:09.496691 24386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:09.496721 24386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.496742 24386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:09.496757 24386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.502318 24386 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:40293
I20260808 14:44:09.502353 24556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:40293 every 8 connection(s)
I20260808 14:44:09.502656 24386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:44:09.503281 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 24386
I20260808 14:44:09.503427 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:09.503638 30371 external_mini_cluster.cc:1428] Setting key e3a4f05b261b073d4c4e82a721a89c2f
I20260808 14:44:09.504652 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37565
--builtin_ntp_servers=127.29.168.212:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:44:09.508479 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.503389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:35913 (local address 127.29.168.254:37565)
0808 14:44:09.503445 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.503447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.503685 (+ 238us) server_negotiation.cc:407] Connection header received
0808 14:44:09.504328 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.504330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.504370 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.504426 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:09.505266 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.505748 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.507007 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.507328 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.507408 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.508191 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:09.508193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:09.508193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:09.508198 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:09.508213 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:09.508217 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:09.508279 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.508340 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.508366 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:44:09.508608 24559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.503298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37565 (local address 127.29.168.194:35913)
0808 14:44:09.503543 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.503595 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.504156 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.504508 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.504512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.504522 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:09.505166 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.505173 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.505834 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.505835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.506922 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.506924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.507420 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.507420 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.507522 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.508059 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:09.508059 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:09.508090 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:09.508110 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:09.508280 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:09.508282 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:09.508284 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.508327 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.508392 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
I20260808 14:44:09.509110 24557 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37565
I20260808 14:44:09.509189 24557 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:09.509367 24557 heartbeater.cc:511] Master 127.29.168.254:37565 requested a full tablet report, sending...
I20260808 14:44:09.509688 24116 ts_manager.cc:194] Registered new tserver with Master: 8b73d58429d8499e89fde164c6618f1b (127.29.168.194:40293)
I20260808 14:44:09.510044 24116 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.194:35913
W20260808 14:44:09.583123 24563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:09.583340 24563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:09.583379 24563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:09.584553 24563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:09.584626 24563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:09.584663 24563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:44:09.586131 24563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:37565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:09.586372 24563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:09.586681 24563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:09.591355 24572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:09.591370 24574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:09.591609 24563 server_base.cc:1034] running on GCE node
W20260808 14:44:09.591370 24571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:09.591902 24563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:09.592141 24563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:09.593302 24563 hybrid_clock.cc:648] HybridClock initialized: now 1786200249593296 us; error 36 us; skew 500 ppm
I20260808 14:44:09.594419 24563 webserver.cc:460] Webserver started at http://127.29.168.195:44451/ using document root <none> and password file <none>
I20260808 14:44:09.594677 24563 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:09.594779 24563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:09.594924 24563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:09.596052 24563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "ce5c215c20014d918bc62f2fbb8fbfd8"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "40884818c7bacb7850e92fe9889cd4f5"
server_key_iv: "d8772f5451fcedeeec6764541e6ab17c"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.596422 24563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "ce5c215c20014d918bc62f2fbb8fbfd8"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "40884818c7bacb7850e92fe9889cd4f5"
server_key_iv: "d8772f5451fcedeeec6764541e6ab17c"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.597764 24563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:09.598485 24581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.598654 24563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:09.598747 24563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "ce5c215c20014d918bc62f2fbb8fbfd8"
format_stamp: "Formatted at 2026-08-08 14:44:09 on dist-test-slave-mjjr"
server_key: "40884818c7bacb7850e92fe9889cd4f5"
server_key_iv: "d8772f5451fcedeeec6764541e6ab17c"
server_key_version: "encryptionkey@0"
I20260808 14:44:09.598825 24563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:09.623467 24563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:09.623786 24563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:09.623924 24563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:09.624156 24563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:09.624460 24563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:09.624516 24563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.624552 24563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:09.624577 24563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:09.630355 24563 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:44745
I20260808 14:44:09.630386 24763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:44745 every 8 connection(s)
I20260808 14:44:09.630709 24563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:44:09.635294 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.631438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:52139 (local address 127.29.168.254:37565)
0808 14:44:09.631535 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.631538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.631688 (+ 150us) server_negotiation.cc:407] Connection header received
0808 14:44:09.632149 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.632150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.632160 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.632206 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:09.632806 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.633244 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.634100 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.634273 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.634330 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.635049 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:09.635050 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:09.635051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:09.635054 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:09.635080 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:09.635083 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:09.635123 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.635194 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.635218 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:44:09.635457 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.631380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37565 (local address 127.29.168.195:52139)
0808 14:44:09.631575 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.631605 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.632067 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.632260 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.632263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.632271 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:09.632745 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.632748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.633321 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.633322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.634032 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.634034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.634353 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.634353 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.634447 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.634916 (+ 469us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:09.634916 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:09.634955 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:09.634974 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:09.635132 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:09.635136 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:09.635138 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.635184 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.635269 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":116,"threads_started":1}
I20260808 14:44:09.635942 24764 heartbeater.cc:347] Connected to a master server at 127.29.168.254:37565
I20260808 14:44:09.636049 24764 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:09.636190 24764 heartbeater.cc:511] Master 127.29.168.254:37565 requested a full tablet report, sending...
I20260808 14:44:09.636544 24116 ts_manager.cc:194] Registered new tserver with Master: ce5c215c20014d918bc62f2fbb8fbfd8 (127.29.168.195:44745)
I20260808 14:44:09.636883 24116 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.195:52139
I20260808 14:44:09.640589 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 24563
I20260808 14:44:09.640662 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:09.640807 30371 external_mini_cluster.cc:1428] Setting key 6aa26232ed90e1527ac305c3a2b6fedf
I20260808 14:44:09.641671 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:09.645371 24174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.642950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45798 (local address 127.29.168.254:37565)
0808 14:44:09.642988 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.642990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.643081 (+ 91us) server_negotiation.cc:407] Connection header received
0808 14:44:09.643128 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.643129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.643136 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.643179 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:09.643350 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.643790 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.644446 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.644616 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.644658 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.645224 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:09.645225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:09.645225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:09.645228 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:09.645235 (+ 7us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:09.645238 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:09.645269 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.645312 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.645327 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:44:09.646883 24116 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45798:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:09.648422 24116 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:09.654434 24780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.650566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.29.168.195:44745)
0808 14:44:09.650727 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.650731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.650979 (+ 248us) server_negotiation.cc:407] Connection header received
0808 14:44:09.651016 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.651018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.651028 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.651114 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:09.651278 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.652333 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.653338 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.654027 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.654099 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.654168 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.654320 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.654361 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260808 14:44:09.654495 24777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.650441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:40293 (local address 127.0.0.1:51366)
0808 14:44:09.650717 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.650754 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.650810 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.651146 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.651147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.651149 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:09.651201 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.651203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.652333 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.652334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.653512 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.653515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.654257 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.654258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.654317 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.654320 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.654366 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.654420 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":32,"thread_start_us":94,"threads_started":1}
I20260808 14:44:09.654498 24783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.650722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.29.168.194:40293)
0808 14:44:09.650974 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.650978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.650988 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:09.651029 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.651031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.651045 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.651340 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:09.651401 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.652244 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.653599 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.654183 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.654258 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.654348 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.654373 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.654407 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":87,"threads_started":1}
I20260808 14:44:09.654866 24776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.650444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44745 (local address 127.0.0.1:44758)
0808 14:44:09.650909 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.650918 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.650967 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.651135 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.651137 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.651141 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:09.651194 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.651196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.652428 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.652429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.653253 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.653255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.654126 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.654127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.654198 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.654213 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.654711 (+ 498us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.654754 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":59,"threads_started":1}
I20260808 14:44:09.655030 24782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.650699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48862 (local address 127.29.168.193:45583)
0808 14:44:09.650881 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:09.650885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:09.651147 (+ 262us) server_negotiation.cc:407] Connection header received
0808 14:44:09.651191 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:09.651193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:09.651207 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:09.651272 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:09.651503 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.652617 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.653753 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.654472 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.654538 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.654625 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:09.654902 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:44:09.654947 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260808 14:44:09.654994 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:09.650459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:45583 (local address 127.0.0.1:48862)
0808 14:44:09.651043 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:09.651051 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:09.651092 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:09.651362 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:09.651363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:09.651364 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:09.651399 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.651400 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.652714 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.652715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.653681 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:09.653683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:09.654662 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:09.654663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:09.654720 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:09.654723 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:09.654769 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:44:09.654805 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":73,"threads_started":1}
I20260808 14:44:09.655175 24468 tablet_service.cc:1467] Processing CreateTablet for tablet 8ead23426cca4dd4a9a1b30334ef8786 (DEFAULT_TABLE table=test-table [id=4ada726600fb4e3cb84b245e16a4fc07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:09.655516 24468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ead23426cca4dd4a9a1b30334ef8786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:09.655608 24653 tablet_service.cc:1467] Processing CreateTablet for tablet 8ead23426cca4dd4a9a1b30334ef8786 (DEFAULT_TABLE table=test-table [id=4ada726600fb4e3cb84b245e16a4fc07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:09.655946 24653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ead23426cca4dd4a9a1b30334ef8786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:09.655969 24284 tablet_service.cc:1467] Processing CreateTablet for tablet 8ead23426cca4dd4a9a1b30334ef8786 (DEFAULT_TABLE table=test-table [id=4ada726600fb4e3cb84b245e16a4fc07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:09.656313 24284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ead23426cca4dd4a9a1b30334ef8786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:09.658619 24784 tablet_bootstrap.cc:492] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: Bootstrap starting.
I20260808 14:44:09.659163 24785 tablet_bootstrap.cc:492] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Bootstrap starting.
I20260808 14:44:09.659493 24784 tablet_bootstrap.cc:654] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:09.659777 24786 tablet_bootstrap.cc:492] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Bootstrap starting.
I20260808 14:44:09.659858 24785 tablet_bootstrap.cc:654] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:09.659850 24784 log.cc:824] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:09.660198 24785 log.cc:824] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:09.660423 24786 tablet_bootstrap.cc:654] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:09.660612 24784 tablet_bootstrap.cc:492] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: No bootstrap required, opened a new log
I20260808 14:44:09.660698 24784 ts_tablet_manager.cc:1397] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:44:09.660724 24786 log.cc:824] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:09.661023 24785 tablet_bootstrap.cc:492] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: No bootstrap required, opened a new log
I20260808 14:44:09.661095 24785 ts_tablet_manager.cc:1397] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:09.661361 24786 tablet_bootstrap.cc:492] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: No bootstrap required, opened a new log
I20260808 14:44:09.661456 24786 ts_tablet_manager.cc:1397] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:09.663277 24786 raft_consensus.cc:348] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:09.663280 24784 raft_consensus.cc:348] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:09.663419 24784 raft_consensus.cc:374] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:09.663419 24786 raft_consensus.cc:374] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:09.663457 24786 raft_consensus.cc:729] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5c215c20014d918bc62f2fbb8fbfd8, State: Initialized, Role: FOLLOWER
I20260808 14:44:09.663481 24784 raft_consensus.cc:729] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23a3fa2eaef14a7690fde91b1158a063, State: Initialized, Role: FOLLOWER
I20260808 14:44:09.663589 24786 consensus_queue.cc:260] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:09.663539 24785 raft_consensus.cc:348] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:09.663594 24784 consensus_queue.cc:260] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:09.663673 24785 raft_consensus.cc:374] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:09.663733 24785 raft_consensus.cc:729] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b73d58429d8499e89fde164c6618f1b, State: Initialized, Role: FOLLOWER
I20260808 14:44:09.663859 24764 heartbeater.cc:503] Master 127.29.168.254:37565 was elected leader, sending a full tablet report...
I20260808 14:44:09.663859 24784 ts_tablet_manager.cc:1428] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:44:09.663962 24380 heartbeater.cc:503] Master 127.29.168.254:37565 was elected leader, sending a full tablet report...
I20260808 14:44:09.664059 24786 ts_tablet_manager.cc:1428] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:44:09.663895 24785 consensus_queue.cc:260] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:09.664353 24785 ts_tablet_manager.cc:1428] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:09.664422 24557 heartbeater.cc:503] Master 127.29.168.254:37565 was elected leader, sending a full tablet report...
W20260808 14:44:09.753204 24558 tablet.cc:2369] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:44:09.878064 24381 tablet.cc:2369] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:44:09.881232 24766 tablet.cc:2369] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:44:10.002473 24793 raft_consensus.cc:482] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:10.002669 24793 raft_consensus.cc:504] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:10.003095 24793 leader_election.cc:288] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b73d58429d8499e89fde164c6618f1b (127.29.168.194:40293), ce5c215c20014d918bc62f2fbb8fbfd8 (127.29.168.195:44745)
I20260808 14:44:10.006296 24780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:10.003388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:59063 (local address 127.29.168.195:44745)
0808 14:44:10.003433 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:10.003436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:10.003579 (+ 143us) server_negotiation.cc:407] Connection header received
0808 14:44:10.003703 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:10.003704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:10.003713 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:10.003765 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:10.003971 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.004477 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.005566 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.005912 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.005968 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:10.005997 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:10.006185 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:44:10.006223 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:44:10.006300 24783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:10.003415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:45449 (local address 127.29.168.194:40293)
0808 14:44:10.003468 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:10.003470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:10.003572 (+ 102us) server_negotiation.cc:407] Connection header received
0808 14:44:10.003813 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:10.003814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:10.003821 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:10.003860 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:10.004021 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.004541 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.005526 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.005915 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.006011 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:10.006019 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:10.006180 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:44:10.006227 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:44:10.006337 24798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:10.003335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:44745 (local address 127.29.168.193:59063)
0808 14:44:10.003488 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:10.003521 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:10.003606 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:10.003786 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:10.003787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:10.003789 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:10.003892 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:10.003894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.004574 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.004576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:10.005438 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:10.005442 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.006002 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.006003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:10.006090 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:10.006094 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:10.006178 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:44:10.006223 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":57,"thread_start_us":62,"threads_started":1}
I20260808 14:44:10.006340 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:10.003265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:40293 (local address 127.29.168.193:45449)
0808 14:44:10.003487 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:10.003499 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:10.003575 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:10.003891 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:10.003892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:10.003893 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:10.003953 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:10.003955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.004610 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.004611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:10.005439 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:10.005441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.006045 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.006046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:10.006093 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:10.006098 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:44:10.006159 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:44:10.006200 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":43,"thread_start_us":97,"threads_started":1}
I20260808 14:44:10.006717 24683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ead23426cca4dd4a9a1b30334ef8786" candidate_uuid: "23a3fa2eaef14a7690fde91b1158a063" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" is_pre_election: true
I20260808 14:44:10.006839 24492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ead23426cca4dd4a9a1b30334ef8786" candidate_uuid: "23a3fa2eaef14a7690fde91b1158a063" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b73d58429d8499e89fde164c6618f1b" is_pre_election: true
I20260808 14:44:10.006881 24683 raft_consensus.cc:2454] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23a3fa2eaef14a7690fde91b1158a063 in term 0.
I20260808 14:44:10.006969 24492 raft_consensus.cc:2454] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23a3fa2eaef14a7690fde91b1158a063 in term 0.
I20260808 14:44:10.007124 24227 leader_election.cc:302] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23a3fa2eaef14a7690fde91b1158a063, ce5c215c20014d918bc62f2fbb8fbfd8; no voters:
I20260808 14:44:10.007273 24793 raft_consensus.cc:2781] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:44:10.007335 24793 raft_consensus.cc:482] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:44:10.007364 24793 raft_consensus.cc:3037] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:10.008164 24793 raft_consensus.cc:504] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:10.008322 24793 leader_election.cc:288] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [CANDIDATE]: Term 1 election: Requested vote from peers 8b73d58429d8499e89fde164c6618f1b (127.29.168.194:40293), ce5c215c20014d918bc62f2fbb8fbfd8 (127.29.168.195:44745)
I20260808 14:44:10.008491 24492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ead23426cca4dd4a9a1b30334ef8786" candidate_uuid: "23a3fa2eaef14a7690fde91b1158a063" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b73d58429d8499e89fde164c6618f1b"
I20260808 14:44:10.008527 24683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ead23426cca4dd4a9a1b30334ef8786" candidate_uuid: "23a3fa2eaef14a7690fde91b1158a063" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8"
I20260808 14:44:10.008594 24683 raft_consensus.cc:3037] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:10.008584 24492 raft_consensus.cc:3037] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:10.009548 24492 raft_consensus.cc:2454] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23a3fa2eaef14a7690fde91b1158a063 in term 1.
I20260808 14:44:10.009548 24683 raft_consensus.cc:2454] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23a3fa2eaef14a7690fde91b1158a063 in term 1.
I20260808 14:44:10.009768 24227 leader_election.cc:302] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23a3fa2eaef14a7690fde91b1158a063, ce5c215c20014d918bc62f2fbb8fbfd8; no voters:
I20260808 14:44:10.009863 24793 raft_consensus.cc:2781] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:10.011744 24793 raft_consensus.cc:686] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [term 1 LEADER]: Becoming Leader. State: Replica: 23a3fa2eaef14a7690fde91b1158a063, State: Running, Role: LEADER
I20260808 14:44:10.011847 24793 consensus_queue.cc:237] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } }
I20260808 14:44:10.012717 24111 catalog_manager.cc:5495] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23a3fa2eaef14a7690fde91b1158a063 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "23a3fa2eaef14a7690fde91b1158a063" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23a3fa2eaef14a7690fde91b1158a063" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45583 } health_report { overall_health: HEALTHY } } }
I20260808 14:44:10.096565 24782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:10.094170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.29.168.193:45583)
0808 14:44:10.094236 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:10.094238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:10.094247 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:44:10.094329 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:10.094330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:10.094349 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:10.094409 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:10.094533 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.094984 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.095849 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:10.096088 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:10.096139 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:10.096283 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:10.096382 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:10.096440 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:10.096481 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 14:44:10.096510 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:44:10.098443 24683 raft_consensus.cc:1261] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 1 FOLLOWER]: Refusing update from remote peer 23a3fa2eaef14a7690fde91b1158a063: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:10.098513 24492 raft_consensus.cc:1261] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 1 FOLLOWER]: Refusing update from remote peer 23a3fa2eaef14a7690fde91b1158a063: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:10.098825 24793 consensus_queue.cc:1035] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce5c215c20014d918bc62f2fbb8fbfd8" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 44745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:10.098969 24799 consensus_queue.cc:1035] T 8ead23426cca4dd4a9a1b30334ef8786 P 23a3fa2eaef14a7690fde91b1158a063 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b73d58429d8499e89fde164c6618f1b" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:10.101205 24803 mvcc.cc:205] Tried to move back new op lower bound from 7316276224400580608 to 7316276224049201152. Current Snapshot: MvccSnapshot[applied={T|T < 7316276224400580608}]
I20260808 14:44:10.101554 24804 mvcc.cc:205] Tried to move back new op lower bound from 7316276224400580608 to 7316276224049201152. Current Snapshot: MvccSnapshot[applied={T|T < 7316276224400580608}]
I20260808 14:44:10.104161 24111 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:10.104293 24111 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:10.105093 24111 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77bc2eb95f8848c8834c9aed9acce87b: Sending DeleteTablet for 3 replicas of tablet 8ead23426cca4dd4a9a1b30334ef8786
I20260808 14:44:10.105475 24284 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ead23426cca4dd4a9a1b30334ef8786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:10 UTC) from {username='slave'} at 127.0.0.1:48862
I20260808 14:44:10.105479 24653 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ead23426cca4dd4a9a1b30334ef8786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:10 UTC) from {username='slave'} at 127.0.0.1:44758
I20260808 14:44:10.105484 24468 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ead23426cca4dd4a9a1b30334ef8786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:10 UTC) from {username='slave'} at 127.0.0.1:51366
I20260808 14:44:10.105762 24819 tablet_replica.cc:330] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: stopping tablet replica
I20260808 14:44:10.105871 24819 raft_consensus.cc:2229] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:10.105980 24819 raft_consensus.cc:2258] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:10.106137 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 24204
I20260808 14:44:10.106196 24818 tablet_replica.cc:330] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: stopping tablet replica
I20260808 14:44:10.106297 24818 raft_consensus.cc:2229] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:10.106379 24818 raft_consensus.cc:2258] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:10.108757 24818 ts_tablet_manager.cc:1905] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:10.110545 24818 ts_tablet_manager.cc:1918] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:10.110618 24818 log.cc:1196] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/8ead23426cca4dd4a9a1b30334ef8786
I20260808 14:44:10.110823 24818 ts_tablet_manager.cc:1939] T 8ead23426cca4dd4a9a1b30334ef8786 P ce5c215c20014d918bc62f2fbb8fbfd8: Deleting consensus metadata
I20260808 14:44:10.111179 24095 catalog_manager.cc:4841] TS ce5c215c20014d918bc62f2fbb8fbfd8 (127.29.168.195:44745): tablet 8ead23426cca4dd4a9a1b30334ef8786 (table test-table [id=4ada726600fb4e3cb84b245e16a4fc07]) successfully deleted
I20260808 14:44:10.111436 24819 ts_tablet_manager.cc:1905] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:10.113330 24819 ts_tablet_manager.cc:1918] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:10.113384 24819 log.cc:1196] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/8ead23426cca4dd4a9a1b30334ef8786
I20260808 14:44:10.113562 24819 ts_tablet_manager.cc:1939] T 8ead23426cca4dd4a9a1b30334ef8786 P 8b73d58429d8499e89fde164c6618f1b: Deleting consensus metadata
I20260808 14:44:10.117240 24098 catalog_manager.cc:4841] TS 8b73d58429d8499e89fde164c6618f1b (127.29.168.194:40293): tablet 8ead23426cca4dd4a9a1b30334ef8786 (table test-table [id=4ada726600fb4e3cb84b245e16a4fc07]) successfully deleted
W20260808 14:44:10.121029 24097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:45583 (error 108)
I20260808 14:44:10.121562 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:10.121417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:45583 (local address 127.0.0.1:48892)
0808 14:44:10.121492 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:10.121533 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:44:10.121665 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 24386
W20260808 14:44:10.121699 24097 catalog_manager.cc:4584] TS 23a3fa2eaef14a7690fde91b1158a063 (127.29.168.193:45583): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ead23426cca4dd4a9a1b30334ef8786: Network error: Client connection negotiation failed: client connection to 127.29.168.193:45583: connect: Connection refused (error 111)
I20260808 14:44:10.128324 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 24563
I20260808 14:44:10.135494 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 24072
2026-08-08T14:44:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1064 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:10 dist-test-slave-mjjr krb5kdc[24824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:10 dist-test-slave-mjjr krb5kdc[24824](info): set up 2 sockets
Aug 08 14:44:10 dist-test-slave-mjjr krb5kdc[24824](info): commencing operation
krb5kdc: starting...
W20260808 14:44:11.305555 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:11.419476 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45047
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:45047
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:11.497714 24844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:11.497885 24844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:11.497905 24844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:11.498914 24844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:11.498950 24844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:11.498962 24844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:11.498973 24844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:11.499020 24844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:11.500392 24844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:45047
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:45047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:11.500631 24844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:11.500851 24844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:11.505511 24851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:11.505542 24852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:11.505707 24854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:11.505743 24844 server_base.cc:1034] running on GCE node
I20260808 14:44:11.505963 24844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:11.506235 24844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:11.507400 24844 hybrid_clock.cc:648] HybridClock initialized: now 1786200251507385 us; error 34 us; skew 500 ppm
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:11.515425 24844 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:11.515925 24844 webserver.cc:460] Webserver started at http://127.29.168.254:46047/ using document root <none> and password file <none>
I20260808 14:44:11.516139 24844 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:11.516204 24844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:11.516357 24844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:11.517390 24844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "525724b4c87f44c5afdc10d67c39bf2c"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "40146da587534c9a413ecfe03b597b3d"
server_key_iv: "65337cc622d13ed99dc1dc3e77a2ecf3"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.517755 24844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "525724b4c87f44c5afdc10d67c39bf2c"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "40146da587534c9a413ecfe03b597b3d"
server_key_iv: "65337cc622d13ed99dc1dc3e77a2ecf3"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.519058 24844 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:11.519796 24863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.519950 24844 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:11.520040 24844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "525724b4c87f44c5afdc10d67c39bf2c"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "40146da587534c9a413ecfe03b597b3d"
server_key_iv: "65337cc622d13ed99dc1dc3e77a2ecf3"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.520110 24844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:11.549633 24844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:11.551846 24844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:11.552000 24844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:11.555961 24844 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:45047
I20260808 14:44:11.555996 24936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:45047 every 8 connection(s)
I20260808 14:44:11.556314 24844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:11.557113 24939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:11.559263 24939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c: Bootstrap starting.
I20260808 14:44:11.559841 24939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:11.560084 24939 log.cc:824] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:11.560672 24939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c: No bootstrap required, opened a new log
I20260808 14:44:11.562161 24939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "525724b4c87f44c5afdc10d67c39bf2c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45047 } }
I20260808 14:44:11.562320 24939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:11.562345 24939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525724b4c87f44c5afdc10d67c39bf2c, State: Initialized, Role: FOLLOWER
I20260808 14:44:11.562479 24939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "525724b4c87f44c5afdc10d67c39bf2c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45047 } }
I20260808 14:44:11.562556 24939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:11.562577 24939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:11.562609 24939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:11.563079 24939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "525724b4c87f44c5afdc10d67c39bf2c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45047 } }
I20260808 14:44:11.563155 24939 leader_election.cc:302] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 525724b4c87f44c5afdc10d67c39bf2c; no voters:
I20260808 14:44:11.563282 24939 leader_election.cc:288] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:11.563366 24943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:11.563556 24943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [term 1 LEADER]: Becoming Leader. State: Replica: 525724b4c87f44c5afdc10d67c39bf2c, State: Running, Role: LEADER
I20260808 14:44:11.563616 24939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:11.563848 24943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "525724b4c87f44c5afdc10d67c39bf2c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45047 } }
I20260808 14:44:11.564011 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 24844
I20260808 14:44:11.564109 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:11.564229 24944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "525724b4c87f44c5afdc10d67c39bf2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "525724b4c87f44c5afdc10d67c39bf2c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45047 } } }
I20260808 14:44:11.564314 24944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:11.564363 30371 external_mini_cluster.cc:1428] Setting key 6a3e478fad7966b06b14e5ca11735117
I20260808 14:44:11.564399 24945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 525724b4c87f44c5afdc10d67c39bf2c. Latest consensus state: current_term: 1 leader_uuid: "525724b4c87f44c5afdc10d67c39bf2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "525724b4c87f44c5afdc10d67c39bf2c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 45047 } } }
I20260808 14:44:11.564476 24945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:11.564525 24947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:11.565035 24947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:11.566718 24947 catalog_manager.cc:1347] Generated new cluster ID: 6e5747022cc24f1a91d4dfeadadc187f
I20260808 14:44:11.566777 24947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:11.576104 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:11.565001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59564 (local address 127.29.168.254:45047)
0808 14:44:11.565203 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:11.565211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:11.565321 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:44:11.565683 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:11.565691 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:11.565753 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:11.565894 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:11.566947 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.568317 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.569308 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.569909 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.569969 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:11.572507 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:11.572510 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:11.572511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:11.572522 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:11.574241 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:11.574589 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:11.574592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:11.574592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:11.574681 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:11.574839 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:11.574839 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:11.574840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:11.575113 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:11.575251 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:11.575728 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 14:44:11.575868 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260808 14:44:11.587450 24947 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:11.588140 24947 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:11.604065 24947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c: Generated new TSK 0
I20260808 14:44:11.604223 24947 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:44:11.634233 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45047
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:11.713032 24974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:11.713212 24974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:11.713236 24974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:11.714351 24974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:11.714391 24974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:11.714442 24974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:44:11.715912 24974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:11.716143 24974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:11.716385 24974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:44:11.721469 24974 server_base.cc:1034] running on GCE node
W20260808 14:44:11.721364 24980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:11.721374 24984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:11.721365 24981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:11.721853 24974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:11.722100 24974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:11.723260 24974 hybrid_clock.cc:648] HybridClock initialized: now 1786200251723238 us; error 58 us; skew 500 ppm
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:11.725834 24974 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:44:11.726280 24974 webserver.cc:460] Webserver started at http://127.29.168.193:41917/ using document root <none> and password file <none>
I20260808 14:44:11.726548 24974 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:11.726616 24974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:11.726776 24974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:11.727916 24974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "75b3a6ae3e74495d8039bf406e87f926"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "71927e89706053c92528dcb58c6a34f6"
server_key_iv: "dcd891d1dc5a9dea35fa0d0bda277a80"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.728281 24974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "75b3a6ae3e74495d8039bf406e87f926"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "71927e89706053c92528dcb58c6a34f6"
server_key_iv: "dcd891d1dc5a9dea35fa0d0bda277a80"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.729524 24974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:11.730218 24994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.730377 24974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.730470 24974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "75b3a6ae3e74495d8039bf406e87f926"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "71927e89706053c92528dcb58c6a34f6"
server_key_iv: "dcd891d1dc5a9dea35fa0d0bda277a80"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.730547 24974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:11.742848 24974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:11.745079 24974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:11.745235 24974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:11.745450 24974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:11.745751 24974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:11.745808 24974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.745836 24974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:11.745862 24974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.751581 24974 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:45867
I20260808 14:44:11.751628 25135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:45867 every 8 connection(s)
I20260808 14:44:11.751936 24974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:11.759101 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 24974
I20260808 14:44:11.759209 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:11.759445 30371 external_mini_cluster.cc:1428] Setting key 5bb854a35a4a79e30f02f69fa6401edc
I20260808 14:44:11.760345 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:11.752607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:35229 (local address 127.29.168.254:45047)
0808 14:44:11.752678 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:11.752680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:11.752904 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:44:11.753299 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:11.753300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:11.753311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:11.753358 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:11.754188 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.754681 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.755615 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.755896 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.755947 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:11.757778 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:11.757780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:11.757780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:11.757786 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:11.758884 (+ 1098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:11.759335 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:11.759336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:11.759337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:11.759386 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:11.759660 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:11.759661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:11.759661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:11.759785 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:11.759840 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:11.760133 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 14:44:11.760250 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:44:11.760471 25139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:11.752593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45047 (local address 127.29.168.193:35229)
0808 14:44:11.752767 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:11.752816 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:11.753225 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:11.753409 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:11.753412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:11.753943 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:11.754110 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:11.754114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.754758 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.754759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:11.755523 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:11.755524 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.755966 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.755967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:11.756054 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:11.756404 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:11.756411 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:11.757697 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:11.758964 (+ 1267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:11.758971 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:11.758973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:11.759262 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:11.759448 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:11.759449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:11.759449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:11.759573 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:11.759849 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:11.759855 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:11.759985 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 14:44:11.760110 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:44:11.760278 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
I20260808 14:44:11.760926 25136 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45047
I20260808 14:44:11.761042 25136 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:11.761233 25136 heartbeater.cc:511] Master 127.29.168.254:45047 requested a full tablet report, sending...
I20260808 14:44:11.761742 24890 ts_manager.cc:194] Registered new tserver with Master: 75b3a6ae3e74495d8039bf406e87f926 (127.29.168.193:45867)
I20260808 14:44:11.762327 24890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:35229
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:44:11.785892 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45047
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:11.869911 25145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:11.870159 25145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:11.870196 25145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:11.871794 25145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:11.871853 25145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:11.871896 25145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:44:11.873762 25145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:11.873979 25145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:11.874219 25145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:44:11.879128 25145 server_base.cc:1034] running on GCE node
W20260808 14:44:11.879102 25151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:11.879112 25152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:11.879139 25154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:11.879577 25145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:11.879842 25145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:11.880978 25145 hybrid_clock.cc:648] HybridClock initialized: now 1786200251880971 us; error 25 us; skew 500 ppm
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:11.883371 25145 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:44:11.883869 25145 webserver.cc:460] Webserver started at http://127.29.168.194:37675/ using document root <none> and password file <none>
I20260808 14:44:11.884047 25145 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:11.884085 25145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:11.884169 25145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:11.885082 25145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "5df1891549454257898cb2aa107d0384"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "9f88177c371dcb8b93b44fffa1b06e04"
server_key_iv: "71b829294d0b6d59b9213a33b6ce325b"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.885354 25145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "5df1891549454257898cb2aa107d0384"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "9f88177c371dcb8b93b44fffa1b06e04"
server_key_iv: "71b829294d0b6d59b9213a33b6ce325b"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.886615 25145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:11.887329 25162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.887516 25145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:11.887612 25145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "5df1891549454257898cb2aa107d0384"
format_stamp: "Formatted at 2026-08-08 14:44:11 on dist-test-slave-mjjr"
server_key: "9f88177c371dcb8b93b44fffa1b06e04"
server_key_iv: "71b829294d0b6d59b9213a33b6ce325b"
server_key_version: "encryptionkey@0"
I20260808 14:44:11.887729 25145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:11.907363 25145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:11.909134 25145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:11.909283 25145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:11.909535 25145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:11.909847 25145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:11.909902 25145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.909942 25145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:11.909973 25145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:11.916115 25145 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:35221
I20260808 14:44:11.916165 25328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:35221 every 8 connection(s)
I20260808 14:44:11.916512 25145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:44:11 dist-test-slave-mjjr krb5kdc[24824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200251, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:11.923605 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 25145
I20260808 14:44:11.923749 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:11.923995 30371 external_mini_cluster.cc:1428] Setting key b5a23d561d37e1a1b99e65d58b9a442e
I20260808 14:44:11.926659 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:11.917314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:38961 (local address 127.29.168.254:45047)
0808 14:44:11.917409 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:11.917412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:11.917584 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:44:11.918136 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:11.918137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:11.918153 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:11.918224 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:11.919227 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.919828 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.920866 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.921083 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.921187 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:11.923439 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:11.923440 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:11.923441 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:11.923448 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:11.925084 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:11.925602 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:11.925603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:11.925604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:11.925660 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:11.925970 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:11.925971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:11.925971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:11.926084 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:11.926150 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:11.926451 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 14:44:11.926587 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:44:11.927017 25333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:11.917235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45047 (local address 127.29.168.194:38961)
0808 14:44:11.917441 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:11.917488 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:11.918016 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:11.918283 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:11.918287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:11.918921 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:11.919099 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:11.919104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.919947 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.919948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:11.920741 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:11.920744 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:11.921216 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:11.921217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:11.921349 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:11.921932 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:11.921940 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:11.923350 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:11.925166 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:11.925174 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:11.925176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:11.925496 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:11.925745 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:11.925746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:11.925746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:11.925884 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:11.926158 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:11.926164 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:11.926319 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 14:44:11.926428 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:44:11.926644 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260808 14:44:11.927538 25329 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45047
I20260808 14:44:11.927659 25329 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:11.927855 25329 heartbeater.cc:511] Master 127.29.168.254:45047 requested a full tablet report, sending...
I20260808 14:44:11.928231 24890 ts_manager.cc:194] Registered new tserver with Master: 5df1891549454257898cb2aa107d0384 (127.29.168.194:35221)
I20260808 14:44:11.928604 24890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:38961
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:44:11.950467 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45047
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:44583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:12.029206 25340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:12.029392 25340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:12.029415 25340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:12.030514 25340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:12.030555 25340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:12.030616 25340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:44:12.032248 25340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:44583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:45047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:12.032475 25340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:12.032697 25340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:12.037518 25345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.037511 25346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.037539 25340 server_base.cc:1034] running on GCE node
W20260808 14:44:12.037513 25351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.037876 25340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:12.038115 25340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:12.039270 25340 hybrid_clock.cc:648] HybridClock initialized: now 1786200252039256 us; error 26 us; skew 500 ppm
Aug 08 14:44:12 dist-test-slave-mjjr krb5kdc[24824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200252, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:12.041635 25340 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:44:12.042006 25340 webserver.cc:460] Webserver started at http://127.29.168.195:34761/ using document root <none> and password file <none>
I20260808 14:44:12.042176 25340 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:12.042214 25340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:12.042300 25340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:12.043239 25340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "84ff2a5c32bb4b2bbe82f81841d814bc"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "40a80b054e9520b9e0c358362ee552da"
server_key_iv: "dee887bbf280538606de3822e575eea4"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.043521 25340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "84ff2a5c32bb4b2bbe82f81841d814bc"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "40a80b054e9520b9e0c358362ee552da"
server_key_iv: "dee887bbf280538606de3822e575eea4"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.044737 25340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:12.045411 25362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.045575 25340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:12.045677 25340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "84ff2a5c32bb4b2bbe82f81841d814bc"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "40a80b054e9520b9e0c358362ee552da"
server_key_iv: "dee887bbf280538606de3822e575eea4"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.045753 25340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:12.051539 25340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:12.053303 25340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:12.053454 25340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:12.053665 25340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:12.053946 25340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:12.053998 25340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.054036 25340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:12.054061 25340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.059597 25340 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:36863
I20260808 14:44:12.059693 25544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:36863 every 8 connection(s)
I20260808 14:44:12.059989 25340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:44:12 dist-test-slave-mjjr krb5kdc[24824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200252, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:12.065670 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 25340
I20260808 14:44:12.065802 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:12.066035 30371 external_mini_cluster.cc:1428] Setting key 6a82212f64bf0a93cae9721c04cf78f0
I20260808 14:44:12.068825 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.060624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:39535 (local address 127.29.168.254:45047)
0808 14:44:12.060668 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.060670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.060916 (+ 246us) server_negotiation.cc:407] Connection header received
0808 14:44:12.061353 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.061354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.061363 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.061408 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.062301 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.062781 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.063732 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.063910 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.063960 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.066231 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.066233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.066233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:12.066241 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.067746 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:12.068081 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:12.068081 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:12.068082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:12.068128 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:12.068335 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:12.068335 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:12.068336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:12.068422 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.068476 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.068708 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.068765 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:12.068957 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.060622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:45047 (local address 127.29.168.195:39535)
0808 14:44:12.060777 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.060807 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.061271 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.061453 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.061455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.062051 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:12.062226 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.062230 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.062856 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.062857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.063609 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.063610 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.063980 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.063980 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.064073 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.064503 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:12.064527 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:12.066126 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:12.067813 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:12.067819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:12.067820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:12.068014 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:12.068183 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:12.068183 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:12.068184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:12.068277 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:12.068481 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:12.068485 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:12.068577 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.068677 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.068784 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
I20260808 14:44:12.069391 25545 heartbeater.cc:347] Connected to a master server at 127.29.168.254:45047
I20260808 14:44:12.069468 25545 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:12.069600 25545 heartbeater.cc:511] Master 127.29.168.254:45047 requested a full tablet report, sending...
I20260808 14:44:12.069886 24890 ts_manager.cc:194] Registered new tserver with Master: 84ff2a5c32bb4b2bbe82f81841d814bc (127.29.168.195:36863)
I20260808 14:44:12.070272 24890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:39535
I20260808 14:44:12.077642 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:12.084385 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.078866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59578 (local address 127.29.168.254:45047)
0808 14:44:12.078917 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.078919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.079050 (+ 131us) server_negotiation.cc:407] Connection header received
0808 14:44:12.079084 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.079085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.079092 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.079136 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.079588 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.080131 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.080763 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.080929 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.080979 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.082202 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.082203 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.082203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:12.082208 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.083318 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:12.083720 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:12.083720 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:12.083721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:12.083766 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:12.083934 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:12.083934 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:12.083935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:12.084058 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.084134 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.084291 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.084334 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:44:12.085958 24890 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:12.087421 24890 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:12.093678 25556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.089406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:36863 (local address 127.0.0.1:46262)
0808 14:44:12.089745 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.089756 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.089807 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.090040 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.090044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.090045 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.090125 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.090127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.091391 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.091392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.092613 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.092615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.093390 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.093392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.093474 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.093490 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.093549 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.093601 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":66,"thread_start_us":77,"threads_started":1}
I20260808 14:44:12.093771 25555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.089406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:35221 (local address 127.0.0.1:38972)
0808 14:44:12.089539 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.089571 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.089637 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.090326 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.090327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.090330 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.090371 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.090373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.091403 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.091404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.092819 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.092822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.093534 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.093535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.093595 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.093598 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.093661 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.093706 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":80,"thread_start_us":86,"threads_started":1}
I20260808 14:44:12.094048 25558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.089659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46262 (local address 127.29.168.195:36863)
0808 14:44:12.089850 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.089855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.089865 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:12.089901 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.089902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.089918 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.090027 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.090209 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.091261 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.092698 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.093305 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.093375 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.093420 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.093868 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.093929 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":95,"threads_started":1}
I20260808 14:44:12.094066 25557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.089417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:45867 (local address 127.0.0.1:54836)
0808 14:44:12.089871 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.089878 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.089903 (+ 25us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.090477 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.090478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.090481 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.090519 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.090521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.091847 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.091848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.092917 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.092919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.093815 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.093816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.093876 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.093879 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.093959 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.094011 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":75,"threads_started":1}
I20260808 14:44:12.094135 25561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.089665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54836 (local address 127.29.168.193:45867)
0808 14:44:12.090152 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.090226 (+ 74us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.090237 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:44:12.090279 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.090281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.090308 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.090390 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.090596 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.091745 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.092996 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.093673 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.093729 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.093772 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.094003 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.094041 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":113,"threads_started":1}
I20260808 14:44:12.094444 25564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.089891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38972 (local address 127.29.168.194:35221)
0808 14:44:12.090091 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.090096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.090123 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:44:12.090163 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.090165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.090183 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.090451 (+ 268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.090527 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.091290 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.092916 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.093449 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.093524 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.093576 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.093673 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.094076 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":94,"threads_started":1}
I20260808 14:44:12.094750 25445 tablet_service.cc:1467] Processing CreateTablet for tablet 4845aa5966104e43ad25e725d24a7ce0 (DEFAULT_TABLE table=test-table [id=fd924a31aa5c4249be615de25542c40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:12.094820 25052 tablet_service.cc:1467] Processing CreateTablet for tablet 4845aa5966104e43ad25e725d24a7ce0 (DEFAULT_TABLE table=test-table [id=fd924a31aa5c4249be615de25542c40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:12.095013 25233 tablet_service.cc:1467] Processing CreateTablet for tablet 4845aa5966104e43ad25e725d24a7ce0 (DEFAULT_TABLE table=test-table [id=fd924a31aa5c4249be615de25542c40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:12.095115 25445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4845aa5966104e43ad25e725d24a7ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.095157 25052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4845aa5966104e43ad25e725d24a7ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.095309 25233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4845aa5966104e43ad25e725d24a7ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.098397 25568 tablet_bootstrap.cc:492] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Bootstrap starting.
I20260808 14:44:12.098460 25565 tablet_bootstrap.cc:492] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Bootstrap starting.
I20260808 14:44:12.098995 25568 tablet_bootstrap.cc:654] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.099035 25565 tablet_bootstrap.cc:654] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.099472 25568 log.cc:824] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.099496 25565 log.cc:824] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.099812 25567 tablet_bootstrap.cc:492] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926: Bootstrap starting.
I20260808 14:44:12.100260 25568 tablet_bootstrap.cc:492] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: No bootstrap required, opened a new log
I20260808 14:44:12.100386 25565 tablet_bootstrap.cc:492] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: No bootstrap required, opened a new log
I20260808 14:44:12.100440 25565 ts_tablet_manager.cc:1397] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:44:12.100438 25567 tablet_bootstrap.cc:654] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.100400 25568 ts_tablet_manager.cc:1397] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:12.101020 25567 log.cc:824] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.101784 25567 tablet_bootstrap.cc:492] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926: No bootstrap required, opened a new log
I20260808 14:44:12.101857 25567 ts_tablet_manager.cc:1397] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:12.102084 25565 raft_consensus.cc:348] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.102237 25565 raft_consensus.cc:374] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.102280 25565 raft_consensus.cc:729] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84ff2a5c32bb4b2bbe82f81841d814bc, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.102392 25565 consensus_queue.cc:260] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.102655 25565 ts_tablet_manager.cc:1428] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:44:12.102821 25545 heartbeater.cc:503] Master 127.29.168.254:45047 was elected leader, sending a full tablet report...
I20260808 14:44:12.102773 25568 raft_consensus.cc:348] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.102949 25568 raft_consensus.cc:374] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.102993 25568 raft_consensus.cc:729] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5df1891549454257898cb2aa107d0384, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.103142 25568 consensus_queue.cc:260] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.103405 25568 ts_tablet_manager.cc:1428] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:12.103430 25329 heartbeater.cc:503] Master 127.29.168.254:45047 was elected leader, sending a full tablet report...
I20260808 14:44:12.103922 25567 raft_consensus.cc:348] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.104090 25567 raft_consensus.cc:374] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.104156 25567 raft_consensus.cc:729] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75b3a6ae3e74495d8039bf406e87f926, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.104260 25567 consensus_queue.cc:260] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.104537 25567 ts_tablet_manager.cc:1428] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:12.104580 25136 heartbeater.cc:503] Master 127.29.168.254:45047 was elected leader, sending a full tablet report...
W20260808 14:44:12.167052 25331 tablet.cc:2369] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:44:12.187906 25578 raft_consensus.cc:482] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:12.188011 25578 raft_consensus.cc:504] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.188408 25578 leader_election.cc:288] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84ff2a5c32bb4b2bbe82f81841d814bc (127.29.168.195:36863), 5df1891549454257898cb2aa107d0384 (127.29.168.194:35221)
I20260808 14:44:12.192049 25564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.188654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:36523 (local address 127.29.168.194:35221)
0808 14:44:12.188741 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.188744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.189068 (+ 324us) server_negotiation.cc:407] Connection header received
0808 14:44:12.189101 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.189102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.189111 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.189164 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.189290 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.189974 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.191114 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.191684 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.191766 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.191773 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.191942 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.191978 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:44:12.192049 25558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.188655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:40259 (local address 127.29.168.195:36863)
0808 14:44:12.188761 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.188763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.188772 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:44:12.188815 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.188816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.188826 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.188882 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.189081 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.189852 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.191112 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.191684 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.191763 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.191773 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.191942 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.191978 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:44:12.192073 25139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.188581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:36863 (local address 127.29.168.193:40259)
0808 14:44:12.188625 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.188642 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.188729 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.188917 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.188919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.188920 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.188999 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.189002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.189922 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.189923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.191013 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.191016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.191770 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.191771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.191854 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.191860 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.191919 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.191976 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":7}
I20260808 14:44:12.192080 25579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.188582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:35221 (local address 127.29.168.193:36523)
0808 14:44:12.188974 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.188985 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.189050 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.189174 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.189175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.189176 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.189224 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.189225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.190033 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.190033 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.191046 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.191048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.191770 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.191771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.191854 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.191861 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.191919 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.191976 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":215,"thread_start_us":118,"threads_started":1}
I20260808 14:44:12.192489 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4845aa5966104e43ad25e725d24a7ce0" candidate_uuid: "75b3a6ae3e74495d8039bf406e87f926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" is_pre_election: true
I20260808 14:44:12.192509 25263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4845aa5966104e43ad25e725d24a7ce0" candidate_uuid: "75b3a6ae3e74495d8039bf406e87f926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5df1891549454257898cb2aa107d0384" is_pre_election: true
I20260808 14:44:12.192631 25475 raft_consensus.cc:2454] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75b3a6ae3e74495d8039bf406e87f926 in term 0.
I20260808 14:44:12.192649 25263 raft_consensus.cc:2454] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75b3a6ae3e74495d8039bf406e87f926 in term 0.
I20260808 14:44:12.192927 24998 leader_election.cc:302] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5df1891549454257898cb2aa107d0384, 75b3a6ae3e74495d8039bf406e87f926; no voters:
I20260808 14:44:12.193078 25578 raft_consensus.cc:2781] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:44:12.193150 25578 raft_consensus.cc:482] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:44:12.193182 25578 raft_consensus.cc:3037] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.193895 25578 raft_consensus.cc:504] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.194036 25578 leader_election.cc:288] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [CANDIDATE]: Term 1 election: Requested vote from peers 84ff2a5c32bb4b2bbe82f81841d814bc (127.29.168.195:36863), 5df1891549454257898cb2aa107d0384 (127.29.168.194:35221)
I20260808 14:44:12.194159 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4845aa5966104e43ad25e725d24a7ce0" candidate_uuid: "75b3a6ae3e74495d8039bf406e87f926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc"
I20260808 14:44:12.194205 25263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4845aa5966104e43ad25e725d24a7ce0" candidate_uuid: "75b3a6ae3e74495d8039bf406e87f926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5df1891549454257898cb2aa107d0384"
I20260808 14:44:12.194238 25475 raft_consensus.cc:3037] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.194272 25263 raft_consensus.cc:3037] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.195129 25263 raft_consensus.cc:2454] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75b3a6ae3e74495d8039bf406e87f926 in term 1.
I20260808 14:44:12.195129 25475 raft_consensus.cc:2454] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75b3a6ae3e74495d8039bf406e87f926 in term 1.
I20260808 14:44:12.195307 24998 leader_election.cc:302] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5df1891549454257898cb2aa107d0384, 75b3a6ae3e74495d8039bf406e87f926; no voters:
I20260808 14:44:12.195410 25578 raft_consensus.cc:2781] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:12.195569 25578 raft_consensus.cc:686] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [term 1 LEADER]: Becoming Leader. State: Replica: 75b3a6ae3e74495d8039bf406e87f926, State: Running, Role: LEADER
I20260808 14:44:12.195688 25578 consensus_queue.cc:237] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } }
I20260808 14:44:12.196532 24890 catalog_manager.cc:5495] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75b3a6ae3e74495d8039bf406e87f926 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "75b3a6ae3e74495d8039bf406e87f926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75b3a6ae3e74495d8039bf406e87f926" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 45867 } health_report { overall_health: HEALTHY } } }
I20260808 14:44:12.207855 25561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.205531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54838 (local address 127.29.168.193:45867)
0808 14:44:12.205576 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.205578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.205586 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:12.205658 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.205659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.205674 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.205729 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:12.205881 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.206309 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.207060 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.207255 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.207331 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.207494 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:12.207583 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:12.207720 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.207752 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.207762 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:44:12.209501 25475 raft_consensus.cc:1261] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 1 FOLLOWER]: Refusing update from remote peer 75b3a6ae3e74495d8039bf406e87f926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:12.209501 25263 raft_consensus.cc:1261] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 1 FOLLOWER]: Refusing update from remote peer 75b3a6ae3e74495d8039bf406e87f926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:12.209875 25583 consensus_queue.cc:1035] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5df1891549454257898cb2aa107d0384" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 35221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:12.209985 25578 consensus_queue.cc:1035] T 4845aa5966104e43ad25e725d24a7ce0 P 75b3a6ae3e74495d8039bf406e87f926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84ff2a5c32bb4b2bbe82f81841d814bc" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 36863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:12.212150 25586 mvcc.cc:205] Tried to move back new op lower bound from 7316276233047339008 to 7316276232994213888. Current Snapshot: MvccSnapshot[applied={T|T < 7316276233047339008}]
I20260808 14:44:12.212639 25588 mvcc.cc:205] Tried to move back new op lower bound from 7316276233047339008 to 7316276232994213888. Current Snapshot: MvccSnapshot[applied={T|T < 7316276233047339008 or (T in {7316276233047339008})}]
I20260808 14:44:12.213151 25589 mvcc.cc:205] Tried to move back new op lower bound from 7316276233047339008 to 7316276232994213888. Current Snapshot: MvccSnapshot[applied={T|T < 7316276233047339008 or (T in {7316276233047339008})}]
I20260808 14:44:12.215111 24890 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:12.215198 24890 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:12.216004 24890 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 525724b4c87f44c5afdc10d67c39bf2c: Sending DeleteTablet for 3 replicas of tablet 4845aa5966104e43ad25e725d24a7ce0
I20260808 14:44:12.216315 25445 tablet_service.cc:1514] Processing DeleteTablet for tablet 4845aa5966104e43ad25e725d24a7ce0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:12 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:46262
I20260808 14:44:12.216387 25052 tablet_service.cc:1514] Processing DeleteTablet for tablet 4845aa5966104e43ad25e725d24a7ce0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:12 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:54836
I20260808 14:44:12.216384 25233 tablet_service.cc:1514] Processing DeleteTablet for tablet 4845aa5966104e43ad25e725d24a7ce0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:12 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:38972
I20260808 14:44:12.216598 25602 tablet_replica.cc:330] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: stopping tablet replica
I20260808 14:44:12.216699 25602 raft_consensus.cc:2229] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:12.216799 25602 raft_consensus.cc:2258] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:12.216892 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 24974
I20260808 14:44:12.217235 25602 ts_tablet_manager.cc:1905] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:12.219714 25602 ts_tablet_manager.cc:1918] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:12.219799 25602 log.cc:1196] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/4845aa5966104e43ad25e725d24a7ce0
I20260808 14:44:12.220091 25602 ts_tablet_manager.cc:1939] T 4845aa5966104e43ad25e725d24a7ce0 P 5df1891549454257898cb2aa107d0384: Deleting consensus metadata
I20260808 14:44:12.220463 24869 catalog_manager.cc:4841] TS 5df1891549454257898cb2aa107d0384 (127.29.168.194:35221): tablet 4845aa5966104e43ad25e725d24a7ce0 (table test-table [id=fd924a31aa5c4249be615de25542c40d]) successfully deleted
I20260808 14:44:12.222621 25601 tablet_replica.cc:330] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: stopping tablet replica
I20260808 14:44:12.222736 25601 raft_consensus.cc:2229] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:12.222846 25601 raft_consensus.cc:2258] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:12.224056 25601 ts_tablet_manager.cc:1905] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:12.225682 25601 ts_tablet_manager.cc:1918] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:12.225744 25601 log.cc:1196] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/4845aa5966104e43ad25e725d24a7ce0
I20260808 14:44:12.226008 25601 ts_tablet_manager.cc:1939] T 4845aa5966104e43ad25e725d24a7ce0 P 84ff2a5c32bb4b2bbe82f81841d814bc: Deleting consensus metadata
I20260808 14:44:12.226394 24868 catalog_manager.cc:4841] TS 84ff2a5c32bb4b2bbe82f81841d814bc (127.29.168.195:36863): tablet 4845aa5966104e43ad25e725d24a7ce0 (table test-table [id=fd924a31aa5c4249be615de25542c40d]) successfully deleted
W20260808 14:44:12.229256 24864 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:45867 (error 108)
I20260808 14:44:12.229777 25557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.229638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:45867 (local address 127.0.0.1:54850)
0808 14:44:12.229698 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.229742 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:45867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:44:12.229826 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 25145
W20260808 14:44:12.229933 24864 catalog_manager.cc:4584] TS 75b3a6ae3e74495d8039bf406e87f926 (127.29.168.193:45867): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4845aa5966104e43ad25e725d24a7ce0: Network error: Client connection negotiation failed: client connection to 127.29.168.193:45867: connect: Connection refused (error 111)
I20260808 14:44:12.238394 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 25340
I20260808 14:44:12.245937 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 24844
2026-08-08T14:44:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2113 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T14:44:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:12Z Disabled control of system clock
I20260808 14:44:12.279493 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43547
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:43547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:12.357982 25613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:12.358178 25613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:12.358196 25613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:12.359340 25613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:12.359375 25613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:12.359388 25613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:12.359400 25613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:12.359412 25613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:12.360734 25613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:43547
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:12.360916 25613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:12.361122 25613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:12.365821 25624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.365816 25622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.365957 25619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.365984 25613 server_base.cc:1034] running on GCE node
I20260808 14:44:12.366329 25613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:12.366657 25613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:12.367816 25613 hybrid_clock.cc:648] HybridClock initialized: now 1786200252367790 us; error 38 us; skew 500 ppm
I20260808 14:44:12.368983 25613 webserver.cc:460] Webserver started at http://127.29.168.254:46729/ using document root <none> and password file <none>
I20260808 14:44:12.369248 25613 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:12.369297 25613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:12.369482 25613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:12.370576 25613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "8da82117263848288c57ca94deb5b15c"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "31c76dc7db790a9d2ccf59a95dc86658"
server_key_iv: "6a7cfe1b77d0c8e5465bc3e8de8a3432"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.370970 25613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "8da82117263848288c57ca94deb5b15c"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "31c76dc7db790a9d2ccf59a95dc86658"
server_key_iv: "6a7cfe1b77d0c8e5465bc3e8de8a3432"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.372417 25613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:12.373157 25633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.373365 25613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:12.373467 25613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "8da82117263848288c57ca94deb5b15c"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "31c76dc7db790a9d2ccf59a95dc86658"
server_key_iv: "6a7cfe1b77d0c8e5465bc3e8de8a3432"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.373571 25613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:12.387904 25613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:12.388186 25613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:12.388329 25613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:12.392724 25613 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:43547
I20260808 14:44:12.392781 25708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:43547 every 8 connection(s)
I20260808 14:44:12.393190 25613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:12.393693 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 25613
I20260808 14:44:12.393849 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:12.394062 30371 external_mini_cluster.cc:1428] Setting key 1bed47edf15320b706e5738377e24c72
I20260808 14:44:12.394201 25710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.397164 25710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c: Bootstrap starting.
I20260808 14:44:12.397776 25710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.398065 25710 log.cc:824] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.398772 25710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c: No bootstrap required, opened a new log
I20260808 14:44:12.399539 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.394585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.29.168.254:43547)
0808 14:44:12.394791 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.394798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.394830 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:44:12.395222 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.395228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.395281 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.395387 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.395680 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.396509 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.397468 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.397891 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.398050 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.398832 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.398837 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.398837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:12.399041 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.399090 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:12.399101 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.399176 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.399275 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.399367 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260808 14:44:12.400946 25710 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da82117263848288c57ca94deb5b15c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43547 } }
I20260808 14:44:12.401108 25710 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.401153 25710 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da82117263848288c57ca94deb5b15c, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.401273 25710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da82117263848288c57ca94deb5b15c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43547 } }
I20260808 14:44:12.401364 25710 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:12.401405 25710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:12.401458 25710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.402098 25710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da82117263848288c57ca94deb5b15c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43547 } }
I20260808 14:44:12.402189 25710 leader_election.cc:302] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8da82117263848288c57ca94deb5b15c; no voters:
I20260808 14:44:12.402329 25710 leader_election.cc:288] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:12.402400 25720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:12.402557 25720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [term 1 LEADER]: Becoming Leader. State: Replica: 8da82117263848288c57ca94deb5b15c, State: Running, Role: LEADER
I20260808 14:44:12.402585 25710 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:12.402647 25720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da82117263848288c57ca94deb5b15c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43547 } }
I20260808 14:44:12.403049 25724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8da82117263848288c57ca94deb5b15c. Latest consensus state: current_term: 1 leader_uuid: "8da82117263848288c57ca94deb5b15c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da82117263848288c57ca94deb5b15c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43547 } } }
I20260808 14:44:12.403165 25724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:12.403049 25723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8da82117263848288c57ca94deb5b15c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da82117263848288c57ca94deb5b15c" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43547 } } }
I20260808 14:44:12.403319 25723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:12.403602 25733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:12.404160 25733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:12.405654 25733 catalog_manager.cc:1347] Generated new cluster ID: 7c22504bc7a149d8b15e6f2808b49515
I20260808 14:44:12.405716 25733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:12.423211 25733 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:12.423884 25733 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:12.432669 25733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c: Generated new TSK 0
I20260808 14:44:12.432862 25733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:12.441054 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43547
--builtin_ntp_servers=127.29.168.212:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:12.544516 25747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:12.544760 25747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:12.544796 25747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:12.545960 25747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:12.546021 25747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:12.546062 25747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:44:12.547535 25747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:12.547832 25747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:12.548133 25747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:12.554014 25756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.554014 25761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.554255 25747 server_base.cc:1034] running on GCE node
W20260808 14:44:12.554338 25755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.554559 25747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:12.554826 25747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:12.555979 25747 hybrid_clock.cc:648] HybridClock initialized: now 1786200252555953 us; error 40 us; skew 500 ppm
I20260808 14:44:12.557390 25747 webserver.cc:460] Webserver started at http://127.29.168.193:46353/ using document root <none> and password file <none>
I20260808 14:44:12.557657 25747 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:12.557703 25747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:12.557838 25747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:12.558863 25747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "8a6fec3540e7472c8d8268db23d4dab2"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "6a06689ca57af61bfcdee809042a427c"
server_key_iv: "9d0bca40ad0a0d7963859319adb973e4"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.559238 25747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "8a6fec3540e7472c8d8268db23d4dab2"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "6a06689ca57af61bfcdee809042a427c"
server_key_iv: "9d0bca40ad0a0d7963859319adb973e4"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.560665 25747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:12.561416 25769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.561628 25747 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:12.561720 25747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "8a6fec3540e7472c8d8268db23d4dab2"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "6a06689ca57af61bfcdee809042a427c"
server_key_iv: "9d0bca40ad0a0d7963859319adb973e4"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.561774 25747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:12.590111 25747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:12.590350 25747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:12.590449 25747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:12.590617 25747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:12.590978 25747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:12.591013 25747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.591065 25747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:12.591090 25747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.596668 25747 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:41733
I20260808 14:44:12.596709 25922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:41733 every 8 connection(s)
I20260808 14:44:12.597052 25747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:44:12.597623 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 25747
I20260808 14:44:12.597736 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:12.598003 30371 external_mini_cluster.cc:1428] Setting key 402c42b68f50dc31d6f4c2232e006856
I20260808 14:44:12.599012 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43547
--builtin_ntp_servers=127.29.168.212:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:44:12.603430 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.598126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:37873 (local address 127.29.168.254:43547)
0808 14:44:12.598196 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.598198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.598212 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:44:12.598972 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.598973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.598985 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.599040 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.599789 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.600292 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.601848 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.602194 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.602272 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.603101 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.603103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.603104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:12.603109 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.603127 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:12.603148 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.603209 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.603348 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.603372 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:44:12.603860 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.597836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:43547 (local address 127.29.168.193:37873)
0808 14:44:12.598033 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.598093 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.598866 (+ 773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.599119 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.599124 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.599136 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:12.599674 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.599679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.600398 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.600399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.601743 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.601746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.602280 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.602281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.602398 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.602925 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:12.602926 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:12.602952 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:12.602972 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:12.603248 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:12.603256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:12.603260 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.603331 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.603441 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260808 14:44:12.604450 25923 heartbeater.cc:347] Connected to a master server at 127.29.168.254:43547
I20260808 14:44:12.604564 25923 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:12.604764 25923 heartbeater.cc:511] Master 127.29.168.254:43547 requested a full tablet report, sending...
I20260808 14:44:12.605254 25658 ts_manager.cc:194] Registered new tserver with Master: 8a6fec3540e7472c8d8268db23d4dab2 (127.29.168.193:41733)
I20260808 14:44:12.605849 25658 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.193:37873
W20260808 14:44:12.682039 25927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:12.682227 25927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:12.682247 25927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:12.683370 25927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:12.683413 25927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:12.683439 25927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:44:12.684885 25927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:12.685143 25927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:12.685441 25927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:12.690332 25934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.690361 25936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.690351 25933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.690555 25927 server_base.cc:1034] running on GCE node
I20260808 14:44:12.690788 25927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:12.691057 25927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:12.692196 25927 hybrid_clock.cc:648] HybridClock initialized: now 1786200252692189 us; error 35 us; skew 500 ppm
I20260808 14:44:12.693368 25927 webserver.cc:460] Webserver started at http://127.29.168.194:39849/ using document root <none> and password file <none>
I20260808 14:44:12.693622 25927 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:12.693693 25927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:12.693846 25927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:12.694862 25927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "5d841171ced24ab9ae83f7ebcce7d6cf"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "9aeb90f7c36472f641dcb6049e709a30"
server_key_iv: "b6332e607c8d85bcb1e80ccee61d0a60"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.695215 25927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "5d841171ced24ab9ae83f7ebcce7d6cf"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "9aeb90f7c36472f641dcb6049e709a30"
server_key_iv: "b6332e607c8d85bcb1e80ccee61d0a60"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.696646 25927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:12.697371 25944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.697532 25927 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:12.697639 25927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "5d841171ced24ab9ae83f7ebcce7d6cf"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "9aeb90f7c36472f641dcb6049e709a30"
server_key_iv: "b6332e607c8d85bcb1e80ccee61d0a60"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.697715 25927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:12.717011 25927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:12.717281 25927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:12.717425 25927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:12.717636 25927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:12.717939 25927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:12.717991 25927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.718036 25927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:12.718060 25927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.723809 25927 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:43763
I20260808 14:44:12.723842 26091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:43763 every 8 connection(s)
I20260808 14:44:12.724143 25927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:44:12.725080 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 25927
I20260808 14:44:12.725203 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:12.725416 30371 external_mini_cluster.cc:1428] Setting key b0c1badde94e58dc6bf69c2eb45ab01a
I20260808 14:44:12.726511 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43547
--builtin_ntp_servers=127.29.168.212:35825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:44:12.729770 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.724868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:33043 (local address 127.29.168.254:43547)
0808 14:44:12.724927 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.724929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.725118 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:44:12.725850 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.725852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.725862 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.725932 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.726731 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.727465 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.728391 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.728604 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.728689 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.729502 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.729504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.729505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:12.729510 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.729525 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:12.729529 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.729582 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.729656 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.729682 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:44:12.729952 26096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.724813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:43547 (local address 127.29.168.194:33043)
0808 14:44:12.724993 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.725029 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.725667 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.725996 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.726000 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.726007 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:12.726643 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.726651 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.727556 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.727556 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.728274 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.728276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.728702 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.728702 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.728834 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.729366 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:12.729366 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:12.729391 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:12.729411 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:12.729585 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:12.729590 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:12.729592 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.729650 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.729745 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260808 14:44:12.730418 26094 heartbeater.cc:347] Connected to a master server at 127.29.168.254:43547
I20260808 14:44:12.730532 26094 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:12.730739 26094 heartbeater.cc:511] Master 127.29.168.254:43547 requested a full tablet report, sending...
I20260808 14:44:12.731084 25658 ts_manager.cc:194] Registered new tserver with Master: 5d841171ced24ab9ae83f7ebcce7d6cf (127.29.168.194:43763)
I20260808 14:44:12.731428 25658 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.194:33043
W20260808 14:44:12.807386 26097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:12.807561 26097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:12.807583 26097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:12.808748 26097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:12.808789 26097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:12.808843 26097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:44:12.810143 26097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:35825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:43547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:12.810369 26097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:12.810662 26097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:12.815464 26103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.815472 26106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:12.815480 26104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:12.815845 26097 server_base.cc:1034] running on GCE node
I20260808 14:44:12.816067 26097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:12.816290 26097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:12.817430 26097 hybrid_clock.cc:648] HybridClock initialized: now 1786200252817421 us; error 27 us; skew 500 ppm
I20260808 14:44:12.818640 26097 webserver.cc:460] Webserver started at http://127.29.168.195:45891/ using document root <none> and password file <none>
I20260808 14:44:12.818902 26097 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:12.818948 26097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:12.819110 26097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:12.820132 26097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "aa61a26346134b2eac934b137da62654"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "afb12f1d373bb520cca2ef3e03804954"
server_key_iv: "41f63b8027357fdc04d38293e6eefdf2"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.820444 26097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "aa61a26346134b2eac934b137da62654"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "afb12f1d373bb520cca2ef3e03804954"
server_key_iv: "41f63b8027357fdc04d38293e6eefdf2"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.821552 26097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:12.822239 26114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.822414 26097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:12.822510 26097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "aa61a26346134b2eac934b137da62654"
format_stamp: "Formatted at 2026-08-08 14:44:12 on dist-test-slave-mjjr"
server_key: "afb12f1d373bb520cca2ef3e03804954"
server_key_iv: "41f63b8027357fdc04d38293e6eefdf2"
server_key_version: "encryptionkey@0"
I20260808 14:44:12.822587 26097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:12.844697 26097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:12.844946 26097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:12.845088 26097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:12.845274 26097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:12.845582 26097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:12.845629 26097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.845659 26097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:12.845683 26097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:12.851217 26097 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:46673
I20260808 14:44:12.851270 26270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:46673 every 8 connection(s)
I20260808 14:44:12.851547 26097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:44:12.852381 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 26097
I20260808 14:44:12.852499 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:12.852727 30371 external_mini_cluster.cc:1428] Setting key 859b05371d119f0ae688c51429aa637e
I20260808 14:44:12.856573 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.852304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:57211 (local address 127.29.168.254:43547)
0808 14:44:12.852383 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.852386 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.852624 (+ 238us) server_negotiation.cc:407] Connection header received
0808 14:44:12.853245 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.853246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.853257 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.853323 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.854049 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.854531 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.855451 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.855613 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.855737 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.856387 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.856388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.856388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:12.856392 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.856405 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:12.856408 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.856447 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.856492 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.856520 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:44:12.856775 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.852224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:43547 (local address 127.29.168.195:57211)
0808 14:44:12.852427 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.852526 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.853152 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.853384 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.853388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.853397 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:12.853973 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.853978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.854612 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.854613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.855367 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.855369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.855747 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.855748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.855857 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.856273 (+ 416us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:12.856274 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:12.856297 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:12.856315 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:12.856446 (+ 131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:12.856448 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:12.856450 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.856486 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.856548 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260808 14:44:12.857219 26271 heartbeater.cc:347] Connected to a master server at 127.29.168.254:43547
I20260808 14:44:12.857338 26271 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:12.857506 26271 heartbeater.cc:511] Master 127.29.168.254:43547 requested a full tablet report, sending...
I20260808 14:44:12.857872 25658 ts_manager.cc:194] Registered new tserver with Master: aa61a26346134b2eac934b137da62654 (127.29.168.195:46673)
I20260808 14:44:12.858211 25658 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.195:57211
I20260808 14:44:12.864483 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:12.868875 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.865911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44002 (local address 127.29.168.254:43547)
0808 14:44:12.865953 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.865955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.866047 (+ 92us) server_negotiation.cc:407] Connection header received
0808 14:44:12.866120 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.866121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.866130 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.866174 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:12.866376 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.866878 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.867630 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.867857 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.867930 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.868575 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:12.868577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:12.868588 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:12.868593 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:12.868605 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:12.868609 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:12.868703 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.868786 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.868803 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:44:12.870190 25658 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:12.871585 25658 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:12.877673 26282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.873629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:46673 (local address 127.0.0.1:49620)
0808 14:44:12.873870 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.873881 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.873937 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.874407 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.874409 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.874411 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.874477 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.874479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.875680 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.875681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.876785 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.876788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.877483 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.877484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.877537 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.877547 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.877593 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.877626 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":1,"thread_start_us":44,"threads_started":1}
I20260808 14:44:12.877717 26283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.873789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49620 (local address 127.29.168.195:46673)
0808 14:44:12.874270 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.874274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.874282 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:12.874312 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.874313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.874323 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.874402 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.874559 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.875583 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.876867 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.877404 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.877477 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.877552 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.877614 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.877648 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":90,"threads_started":1}
I20260808 14:44:12.878315 26181 tablet_service.cc:1467] Processing CreateTablet for tablet dceaf8974b8346968799b5c7d655d978 (DEFAULT_TABLE table=test-table [id=7b15eac5f76a4bcdb7c9feded2e61ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:12.878388 26279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.873629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43763 (local address 127.0.0.1:55424)
0808 14:44:12.873771 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.873838 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.873933 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.875123 (+ 1190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.875124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.875126 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.875168 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.875169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.876165 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.876166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.877227 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.877229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.878165 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.878166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.878235 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.878239 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.878287 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.878323 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":51,"threads_started":1}
I20260808 14:44:12.878641 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.874777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.29.168.194:43763)
0808 14:44:12.874963 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.874967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.874977 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:12.875014 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.875021 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.875032 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.875112 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.875227 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.876090 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.877327 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.878064 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.878164 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.878253 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.878520 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.878565 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":119,"threads_started":1}
I20260808 14:44:12.878669 26181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dceaf8974b8346968799b5c7d655d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.879411 26284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.874005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:41733 (local address 127.0.0.1:58084)
0808 14:44:12.874145 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.874156 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.874200 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.874856 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.874857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.874859 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.874919 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.874920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.876057 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.876059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.877233 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.877235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.879180 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.879181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.879235 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.879238 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.879308 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.879346 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260808 14:44:12.879434 26285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.874262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58084 (local address 127.29.168.193:41733)
0808 14:44:12.874575 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.874580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.874590 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:12.874649 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.874651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.874665 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.874796 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.874993 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.875980 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.878307 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.879102 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.879182 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.879256 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.879324 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.879361 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":212,"threads_started":1}
I20260808 14:44:12.879585 26007 tablet_service.cc:1467] Processing CreateTablet for tablet dceaf8974b8346968799b5c7d655d978 (DEFAULT_TABLE table=test-table [id=7b15eac5f76a4bcdb7c9feded2e61ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:12.879925 26007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dceaf8974b8346968799b5c7d655d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.880064 25830 tablet_service.cc:1467] Processing CreateTablet for tablet dceaf8974b8346968799b5c7d655d978 (DEFAULT_TABLE table=test-table [id=7b15eac5f76a4bcdb7c9feded2e61ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:12.880358 25830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dceaf8974b8346968799b5c7d655d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:12.882902 26293 tablet_bootstrap.cc:492] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Bootstrap starting.
I20260808 14:44:12.882972 26294 tablet_bootstrap.cc:492] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2: Bootstrap starting.
I20260808 14:44:12.883097 26290 tablet_bootstrap.cc:492] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Bootstrap starting.
I20260808 14:44:12.883563 26293 tablet_bootstrap.cc:654] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.883592 26294 tablet_bootstrap.cc:654] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.883687 26290 tablet_bootstrap.cc:654] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:12.883898 26294 log.cc:824] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.883926 26293 log.cc:824] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.884003 26290 log.cc:824] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:12.884635 26293 tablet_bootstrap.cc:492] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: No bootstrap required, opened a new log
I20260808 14:44:12.884644 26294 tablet_bootstrap.cc:492] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2: No bootstrap required, opened a new log
I20260808 14:44:12.884708 26293 ts_tablet_manager.cc:1397] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:44:12.884708 26294 ts_tablet_manager.cc:1397] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:12.887213 26293 raft_consensus.cc:348] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.887239 26294 raft_consensus.cc:348] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.887379 26294 raft_consensus.cc:374] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.887379 26293 raft_consensus.cc:374] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.887415 26294 raft_consensus.cc:729] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a6fec3540e7472c8d8268db23d4dab2, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.887415 26293 raft_consensus.cc:729] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d841171ced24ab9ae83f7ebcce7d6cf, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.887531 26293 consensus_queue.cc:260] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.887531 26294 consensus_queue.cc:260] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.887825 26294 ts_tablet_manager.cc:1428] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 14:44:12.887825 26293 ts_tablet_manager.cc:1428] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:44:12.887876 25923 heartbeater.cc:503] Master 127.29.168.254:43547 was elected leader, sending a full tablet report...
I20260808 14:44:12.887873 26094 heartbeater.cc:503] Master 127.29.168.254:43547 was elected leader, sending a full tablet report...
I20260808 14:44:12.888304 26290 tablet_bootstrap.cc:492] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: No bootstrap required, opened a new log
I20260808 14:44:12.888363 26290 ts_tablet_manager.cc:1397] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 14:44:12.890317 26290 raft_consensus.cc:348] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.890424 26290 raft_consensus.cc:374] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:12.890443 26290 raft_consensus.cc:729] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa61a26346134b2eac934b137da62654, State: Initialized, Role: FOLLOWER
I20260808 14:44:12.890542 26290 consensus_queue.cc:260] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.890738 26290 ts_tablet_manager.cc:1428] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:44:12.890812 26271 heartbeater.cc:503] Master 127.29.168.254:43547 was elected leader, sending a full tablet report...
I20260808 14:44:12.970990 26300 raft_consensus.cc:482] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:12.971128 26300 raft_consensus.cc:504] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.971522 26300 leader_election.cc:288] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d841171ced24ab9ae83f7ebcce7d6cf (127.29.168.194:43763), aa61a26346134b2eac934b137da62654 (127.29.168.195:46673)
I20260808 14:44:12.974220 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.971812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:34705 (local address 127.29.168.194:43763)
0808 14:44:12.971872 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.971874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.971882 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:12.971914 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.971915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.971925 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.971998 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.972151 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.972615 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.973554 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.973900 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.973977 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.973984 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.974122 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.974156 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:44:12.974220 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.971727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:43763 (local address 127.29.168.193:34705)
0808 14:44:12.971797 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.971808 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.971854 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.972001 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.972002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.972004 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.972079 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.972081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.972702 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.972703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.973439 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.973440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.973976 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.973977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.974043 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.974046 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.974114 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.974154 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:44:12.974328 26283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.971834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:34827 (local address 127.29.168.195:46673)
0808 14:44:12.971882 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.971884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.972010 (+ 126us) server_negotiation.cc:407] Connection header received
0808 14:44:12.972083 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.972085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.972094 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.972160 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:12.972334 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.972776 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.973696 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.974014 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.974085 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.974092 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.974237 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.974271 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:44:12.974344 26304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.971771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:46673 (local address 127.29.168.193:34827)
0808 14:44:12.971933 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:12.971942 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:12.972025 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:12.972175 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:12.972176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:12.972177 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:12.972248 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.972250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.972876 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.972877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.973590 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:12.973592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.974108 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.974109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:12.974169 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.974172 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:12.974232 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:44:12.974266 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
I20260808 14:44:12.974550 26033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dceaf8974b8346968799b5c7d655d978" candidate_uuid: "8a6fec3540e7472c8d8268db23d4dab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" is_pre_election: true
W20260808 14:44:12.974684 26095 tablet.cc:2369] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:44:12.974720 26033 raft_consensus.cc:2454] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a6fec3540e7472c8d8268db23d4dab2 in term 0.
I20260808 14:44:12.974821 26209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dceaf8974b8346968799b5c7d655d978" candidate_uuid: "8a6fec3540e7472c8d8268db23d4dab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa61a26346134b2eac934b137da62654" is_pre_election: true
I20260808 14:44:12.974941 25774 leader_election.cc:302] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d841171ced24ab9ae83f7ebcce7d6cf, 8a6fec3540e7472c8d8268db23d4dab2; no voters:
I20260808 14:44:12.974963 26209 raft_consensus.cc:2454] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a6fec3540e7472c8d8268db23d4dab2 in term 0.
I20260808 14:44:12.975071 26300 raft_consensus.cc:2781] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:44:12.975162 26300 raft_consensus.cc:482] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:44:12.975189 26300 raft_consensus.cc:3037] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.976034 26300 raft_consensus.cc:504] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.976178 26300 leader_election.cc:288] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [CANDIDATE]: Term 1 election: Requested vote from peers 5d841171ced24ab9ae83f7ebcce7d6cf (127.29.168.194:43763), aa61a26346134b2eac934b137da62654 (127.29.168.195:46673)
I20260808 14:44:12.976348 26209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dceaf8974b8346968799b5c7d655d978" candidate_uuid: "8a6fec3540e7472c8d8268db23d4dab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa61a26346134b2eac934b137da62654"
I20260808 14:44:12.976363 26033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dceaf8974b8346968799b5c7d655d978" candidate_uuid: "8a6fec3540e7472c8d8268db23d4dab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf"
I20260808 14:44:12.976435 26209 raft_consensus.cc:3037] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.976441 26033 raft_consensus.cc:3037] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:12.977211 26209 raft_consensus.cc:2454] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a6fec3540e7472c8d8268db23d4dab2 in term 1.
I20260808 14:44:12.977267 26033 raft_consensus.cc:2454] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a6fec3540e7472c8d8268db23d4dab2 in term 1.
I20260808 14:44:12.977407 25770 leader_election.cc:302] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a6fec3540e7472c8d8268db23d4dab2, aa61a26346134b2eac934b137da62654; no voters:
I20260808 14:44:12.977485 26300 raft_consensus.cc:2781] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:12.977633 26300 raft_consensus.cc:686] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [term 1 LEADER]: Becoming Leader. State: Replica: 8a6fec3540e7472c8d8268db23d4dab2, State: Running, Role: LEADER
I20260808 14:44:12.977732 26300 consensus_queue.cc:237] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } }
I20260808 14:44:12.978518 25657 catalog_manager.cc:5495] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a6fec3540e7472c8d8268db23d4dab2 (127.29.168.193). New cstate: current_term: 1 leader_uuid: "8a6fec3540e7472c8d8268db23d4dab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a6fec3540e7472c8d8268db23d4dab2" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 41733 } health_report { overall_health: HEALTHY } } }
I20260808 14:44:12.992020 26285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:12.989920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58094 (local address 127.29.168.193:41733)
0808 14:44:12.989971 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:12.989973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:12.989987 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:44:12.990013 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:12.990014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:12.990027 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:12.990085 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:12.990175 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.990604 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.991273 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:12.991440 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:12.991486 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:12.991609 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:12.991765 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:12.991843 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:12.991902 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:44:12.991910 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:44:12.993585 26209 raft_consensus.cc:1261] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 1 FOLLOWER]: Refusing update from remote peer 8a6fec3540e7472c8d8268db23d4dab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:12.993602 26033 raft_consensus.cc:1261] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 1 FOLLOWER]: Refusing update from remote peer 8a6fec3540e7472c8d8268db23d4dab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:12.993899 26300 consensus_queue.cc:1035] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d841171ced24ab9ae83f7ebcce7d6cf" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 43763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:12.994019 26305 consensus_queue.cc:1035] T dceaf8974b8346968799b5c7d655d978 P 8a6fec3540e7472c8d8268db23d4dab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa61a26346134b2eac934b137da62654" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 46673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:12.996255 26308 mvcc.cc:205] Tried to move back new op lower bound from 7316276236259524608 to 7316276236197335040. Current Snapshot: MvccSnapshot[applied={T|T < 7316276236259524608}]
I20260808 14:44:12.997592 26311 mvcc.cc:205] Tried to move back new op lower bound from 7316276236259524608 to 7316276236197335040. Current Snapshot: MvccSnapshot[applied={T|T < 7316276236259524608 or (T in {7316276236259524608})}]
I20260808 14:44:12.998672 25657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:12.998768 25657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:12.999471 25657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8da82117263848288c57ca94deb5b15c: Sending DeleteTablet for 3 replicas of tablet dceaf8974b8346968799b5c7d655d978
I20260808 14:44:12.999816 26007 tablet_service.cc:1514] Processing DeleteTablet for tablet dceaf8974b8346968799b5c7d655d978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:12 UTC) from {username='slave'} at 127.0.0.1:55424
I20260808 14:44:12.999851 25830 tablet_service.cc:1514] Processing DeleteTablet for tablet dceaf8974b8346968799b5c7d655d978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:12 UTC) from {username='slave'} at 127.0.0.1:58084
I20260808 14:44:13.000077 26323 tablet_replica.cc:330] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: stopping tablet replica
I20260808 14:44:13.000191 26181 tablet_service.cc:1514] Processing DeleteTablet for tablet dceaf8974b8346968799b5c7d655d978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:12 UTC) from {username='slave'} at 127.0.0.1:49620
I20260808 14:44:13.000254 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 25747
I20260808 14:44:13.000195 26323 raft_consensus.cc:2229] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:13.010329 26326 tablet_replica.cc:330] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: stopping tablet replica
I20260808 14:44:13.010447 26326 raft_consensus.cc:2229] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:13.010546 26326 raft_consensus.cc:2258] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:13.011161 26326 ts_tablet_manager.cc:1905] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:13.013361 26323 raft_consensus.cc:2258] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:13.013383 26326 ts_tablet_manager.cc:1918] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:13.013638 26326 log.cc:1196] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/dceaf8974b8346968799b5c7d655d978
I20260808 14:44:13.013787 26323 ts_tablet_manager.cc:1905] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:13.014022 26326 ts_tablet_manager.cc:1939] T dceaf8974b8346968799b5c7d655d978 P aa61a26346134b2eac934b137da62654: Deleting consensus metadata
I20260808 14:44:13.014472 25634 catalog_manager.cc:4841] TS aa61a26346134b2eac934b137da62654 (127.29.168.195:46673): tablet dceaf8974b8346968799b5c7d655d978 (table test-table [id=7b15eac5f76a4bcdb7c9feded2e61ad1]) successfully deleted
I20260808 14:44:13.015148 26323 ts_tablet_manager.cc:1918] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:13.015234 26323 log.cc:1196] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/dceaf8974b8346968799b5c7d655d978
I20260808 14:44:13.015446 26323 ts_tablet_manager.cc:1939] T dceaf8974b8346968799b5c7d655d978 P 5d841171ced24ab9ae83f7ebcce7d6cf: Deleting consensus metadata
I20260808 14:44:13.015909 25638 catalog_manager.cc:4841] TS 5d841171ced24ab9ae83f7ebcce7d6cf (127.29.168.194:43763): tablet dceaf8974b8346968799b5c7d655d978 (table test-table [id=7b15eac5f76a4bcdb7c9feded2e61ad1]) successfully deleted
W20260808 14:44:13.018386 25637 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:41733 (error 108)
I20260808 14:44:13.018939 26284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:13.018764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:41733 (local address 127.0.0.1:58108)
0808 14:44:13.018851 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:13.018908 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 14:44:13.018960 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 25927
W20260808 14:44:13.019057 25637 catalog_manager.cc:4584] TS 8a6fec3540e7472c8d8268db23d4dab2 (127.29.168.193:41733): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dceaf8974b8346968799b5c7d655d978: Network error: Client connection negotiation failed: client connection to 127.29.168.193:41733: connect: Connection refused (error 111)
I20260808 14:44:13.028436 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 26097
I20260808 14:44:13.038802 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 25613
2026-08-08T14:44:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (793 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:13 dist-test-slave-mjjr krb5kdc[26331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:13 dist-test-slave-mjjr krb5kdc[26331](info): set up 2 sockets
Aug 08 14:44:13 dist-test-slave-mjjr krb5kdc[26331](info): commencing operation
krb5kdc: starting...
W20260808 14:44:14.206861 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:14.319705 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39975
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:39975
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:14.398671 26353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:14.398852 26353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:14.398871 26353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:14.399848 26353 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:14.399880 26353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:14.399892 26353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:14.399904 26353 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:14.399914 26353 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:14.401237 26353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:39975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:14.401422 26353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:14.401567 26353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:14.406140 26364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.406142 26368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.406167 26363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:14.406497 26353 server_base.cc:1034] running on GCE node
I20260808 14:44:14.406703 26353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:14.406917 26353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:14.408046 26353 hybrid_clock.cc:648] HybridClock initialized: now 1786200254408032 us; error 30 us; skew 500 ppm
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:14.410365 26353 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:14.410810 26353 webserver.cc:460] Webserver started at http://127.29.168.254:44281/ using document root <none> and password file <none>
I20260808 14:44:14.411012 26353 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:14.411051 26353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:14.411180 26353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:14.412281 26353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "7e9a3565961a4d808aa10fa951799622"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "76efe1714c67ca27f4f32627aa512062"
server_key_iv: "84c6134a298901750f283d35ac9769d3"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.412629 26353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "7e9a3565961a4d808aa10fa951799622"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "76efe1714c67ca27f4f32627aa512062"
server_key_iv: "84c6134a298901750f283d35ac9769d3"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.413940 26353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:14.414665 26375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.414883 26353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:14.414992 26353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "7e9a3565961a4d808aa10fa951799622"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "76efe1714c67ca27f4f32627aa512062"
server_key_iv: "84c6134a298901750f283d35ac9769d3"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.415062 26353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:14.423293 26353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:14.425506 26353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:14.425670 26353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:14.429855 26353 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:39975
I20260808 14:44:14.429903 26447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:39975 every 8 connection(s)
I20260808 14:44:14.430254 26353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:14.431092 26448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:14.433373 26448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: Bootstrap starting.
I20260808 14:44:14.433928 26448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:14.434229 26448 log.cc:824] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:14.434477 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 26353
I20260808 14:44:14.434592 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:14.434772 30371 external_mini_cluster.cc:1428] Setting key 5cc5cb5b664de00dded90c0d807b0a48
I20260808 14:44:14.435009 26448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: No bootstrap required, opened a new log
I20260808 14:44:14.436697 26448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e9a3565961a4d808aa10fa951799622" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39975 } }
I20260808 14:44:14.436844 26448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:14.436885 26448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9a3565961a4d808aa10fa951799622, State: Initialized, Role: FOLLOWER
I20260808 14:44:14.437003 26448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e9a3565961a4d808aa10fa951799622" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39975 } }
I20260808 14:44:14.437081 26448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:14.437122 26448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:14.437170 26448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:14.437940 26448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e9a3565961a4d808aa10fa951799622" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39975 } }
I20260808 14:44:14.438053 26448 leader_election.cc:302] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e9a3565961a4d808aa10fa951799622; no voters:
I20260808 14:44:14.438233 26448 leader_election.cc:288] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:14.438261 26457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:14.438375 26457 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [term 1 LEADER]: Becoming Leader. State: Replica: 7e9a3565961a4d808aa10fa951799622, State: Running, Role: LEADER
I20260808 14:44:14.438454 26457 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e9a3565961a4d808aa10fa951799622" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39975 } }
I20260808 14:44:14.438494 26448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:14.438766 26457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e9a3565961a4d808aa10fa951799622. Latest consensus state: current_term: 1 leader_uuid: "7e9a3565961a4d808aa10fa951799622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e9a3565961a4d808aa10fa951799622" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39975 } } }
I20260808 14:44:14.438827 26457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:14.438789 26458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e9a3565961a4d808aa10fa951799622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e9a3565961a4d808aa10fa951799622" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39975 } } }
I20260808 14:44:14.438963 26458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622 [sys.catalog]: This master's current role is: LEADER
W20260808 14:44:14.440198 26485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:14.440263 26485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:14.440326 26466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:14.440513 26466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:14.442018 26466 catalog_manager.cc:1347] Generated new cluster ID: 0d8ca7dbadae4d1f83a1840d5a40047c
I20260808 14:44:14.442068 26466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:14.446334 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.435226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52604 (local address 127.29.168.254:39975)
0808 14:44:14.435391 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.435400 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.435436 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:44:14.436688 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.436695 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.436746 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.436871 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:14.437547 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.438558 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.439650 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.440224 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.440613 (+ 389us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.442888 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:14.442892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:14.442892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:14.442903 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:14.444660 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.444977 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.444980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.444981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.445090 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.445325 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.445326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.445326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.445574 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:14.445721 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.445897 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.446144 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260808 14:44:14.460880 26466 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:14.461584 26466 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:14.472301 26466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: Generated new TSK 0
I20260808 14:44:14.472476 26466 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.168.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
Entry for principal kudu/127.29.168.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab.
I20260808 14:44:14.502983 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39975
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:14.584262 26493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:14.584451 26493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:14.584473 26493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:14.585549 26493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:14.585587 26493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:14.585613 26493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:44:14.587014 26493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.193.keytab
--principal=kudu/127.29.168.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:14.587198 26493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:14.587442 26493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:14.592172 26500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.592185 26501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.592185 26504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:14.592415 26493 server_base.cc:1034] running on GCE node
I20260808 14:44:14.592631 26493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:14.592918 26493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:14.594107 26493 hybrid_clock.cc:648] HybridClock initialized: now 1786200254594106 us; error 42 us; skew 500 ppm
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:14.596529 26493 init.cc:377] Logged in from keytab as kudu/127.29.168.193@KRBTEST.COM (short username kudu)
I20260808 14:44:14.597014 26493 webserver.cc:460] Webserver started at http://127.29.168.193:35505/ using document root <none> and password file <none>
I20260808 14:44:14.597251 26493 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:14.597318 26493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:14.597489 26493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:14.598483 26493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "77251985e78742728b47d983025e63f7"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "a8c188582c53863cf78ae884fe0eafae"
server_key_iv: "7286885b78859e7a71c2b7d89717afd1"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.598843 26493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "77251985e78742728b47d983025e63f7"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "a8c188582c53863cf78ae884fe0eafae"
server_key_iv: "7286885b78859e7a71c2b7d89717afd1"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.600219 26493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:44:14.600936 26515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.601106 26493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:14.601204 26493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "77251985e78742728b47d983025e63f7"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "a8c188582c53863cf78ae884fe0eafae"
server_key_iv: "7286885b78859e7a71c2b7d89717afd1"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.601284 26493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:14.613018 26493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:14.614678 26493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:14.614840 26493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:14.615051 26493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:14.615356 26493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:14.615418 26493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.615458 26493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:14.615486 26493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.621797 26493 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:35357
I20260808 14:44:14.621838 26683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:35357 every 8 connection(s)
I20260808 14:44:14.622180 26493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.193@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:14.627959 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 26493
I20260808 14:44:14.628070 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:14.628275 30371 external_mini_cluster.cc:1428] Setting key 82eba2720679ac16dda0c2aed4248584
I20260808 14:44:14.631354 26688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.622858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39975 (local address 127.29.168.193:58907)
0808 14:44:14.623015 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:14.623046 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:14.623461 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:14.623735 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:14.623744 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:14.624282 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:14.624455 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.624459 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.625120 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.625121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.625839 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.625841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.626176 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.626177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.626263 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.626694 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:14.626701 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:14.628156 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:14.629978 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:14.629985 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:14.629987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:14.630316 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:14.630498 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:14.630499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:14.630499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:14.630630 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:14.630915 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:14.630921 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:14.631015 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 14:44:14.631121 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:44:14.631217 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
I20260808 14:44:14.631372 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.622876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:58907 (local address 127.29.168.254:39975)
0808 14:44:14.622931 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.622933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.623132 (+ 199us) server_negotiation.cc:407] Connection header received
0808 14:44:14.623547 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.623548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.623563 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.623619 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:14.624543 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.625044 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.625911 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.626107 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.626162 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.628265 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:14.628266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:14.628266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:14.628276 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:14.629886 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.630389 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.630390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.630390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.630438 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.630702 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.630703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.630703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.630840 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:14.630908 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.631163 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.631262 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:44:14.631825 26686 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39975
I20260808 14:44:14.631927 26686 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:14.632090 26686 heartbeater.cc:511] Master 127.29.168.254:39975 requested a full tablet report, sending...
I20260808 14:44:14.632567 26398 ts_manager.cc:194] Registered new tserver with Master: 77251985e78742728b47d983025e63f7 (127.29.168.193:35357)
I20260808 14:44:14.633281 26398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.193@KRBTEST.COM'} at 127.29.168.193:58907
WARNING: no policy specified for kudu/127.29.168.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
Entry for principal kudu/127.29.168.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab.
I20260808 14:44:14.652495 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39975
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:14.730151 26692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:14.730314 26692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:14.730335 26692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:14.731349 26692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:14.731386 26692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:14.731431 26692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:44:14.732849 26692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.194.keytab
--principal=kudu/127.29.168.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:14.733081 26692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:14.733342 26692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:14.737938 26697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.737950 26698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:14.738023 26692 server_base.cc:1034] running on GCE node
W20260808 14:44:14.737993 26702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:14.738353 26692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:14.738605 26692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:14.739765 26692 hybrid_clock.cc:648] HybridClock initialized: now 1786200254739753 us; error 41 us; skew 500 ppm
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:14.742197 26692 init.cc:377] Logged in from keytab as kudu/127.29.168.194@KRBTEST.COM (short username kudu)
I20260808 14:44:14.742584 26692 webserver.cc:460] Webserver started at http://127.29.168.194:34901/ using document root <none> and password file <none>
I20260808 14:44:14.742846 26692 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:14.742895 26692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:14.743085 26692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:14.744153 26692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "533b042977724dcc9ae4bb996a78856c"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "5052d93c83359a5fac38910eda23b938"
server_key_iv: "9911229702028fc732e70804b74c7b98"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.744530 26692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "533b042977724dcc9ae4bb996a78856c"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "5052d93c83359a5fac38910eda23b938"
server_key_iv: "9911229702028fc732e70804b74c7b98"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.745869 26692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:14.746654 26710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.746830 26692 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:14.746924 26692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "533b042977724dcc9ae4bb996a78856c"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "5052d93c83359a5fac38910eda23b938"
server_key_iv: "9911229702028fc732e70804b74c7b98"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.747013 26692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:14.765865 26692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:14.767812 26692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:14.767977 26692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:14.768226 26692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:14.768538 26692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:14.768595 26692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.768631 26692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:14.768661 26692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.774989 26692 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38101
I20260808 14:44:14.775025 26875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38101 every 8 connection(s)
I20260808 14:44:14.775342 26692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:44:14.776754 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 26692
I20260808 14:44:14.776892 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:14.777112 30371 external_mini_cluster.cc:1428] Setting key 7a78f316a91fb0758612bb24f0099312
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.194@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:14.785828 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.776103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:56145 (local address 127.29.168.254:39975)
0808 14:44:14.776151 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.776154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.776360 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:44:14.776833 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.776835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.776850 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.776932 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:14.778112 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.778572 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.780015 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.780347 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.780437 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.782937 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:14.782938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:14.782938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:14.782945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:14.784340 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.784896 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.784897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.784897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.784943 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.785228 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.785228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.785228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.785319 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:14.785365 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.785700 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.785762 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:14.786090 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.776037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39975 (local address 127.29.168.194:56145)
0808 14:44:14.776235 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:14.776269 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:14.776723 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:14.777062 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:14.777066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:14.777788 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:14.778020 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.778025 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.778664 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.778665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.779934 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.779937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.780440 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.780441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.780533 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.781038 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:14.781046 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:14.782838 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:14.784430 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:14.784438 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:14.784440 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:14.784807 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:14.785011 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:14.785012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:14.785013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:14.785154 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:14.785384 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:14.785391 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:14.785558 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 14:44:14.785691 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 14:44:14.785872 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":67,"threads_started":1}
I20260808 14:44:14.786648 26876 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39975
I20260808 14:44:14.786738 26876 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:14.786918 26876 heartbeater.cc:511] Master 127.29.168.254:39975 requested a full tablet report, sending...
I20260808 14:44:14.787293 26398 ts_manager.cc:194] Registered new tserver with Master: 533b042977724dcc9ae4bb996a78856c (127.29.168.194:38101)
WARNING: no policy specified for kudu/127.29.168.195@KRBTEST.COM; defaulting to no policy
I20260808 14:44:14.787708 26398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.194@KRBTEST.COM'} at 127.29.168.194:56145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
Entry for principal kudu/127.29.168.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab.
I20260808 14:44:14.804293 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39975
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:14.882155 26881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:14.882344 26881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:14.882366 26881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:14.883476 26881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:14.883513 26881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:14.883558 26881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:44:14.884960 26881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.195.keytab
--principal=kudu/127.29.168.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:39975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:14.885181 26881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:14.885401 26881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:14.890090 26887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.890127 26890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:14.890102 26888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:14.890132 26881 server_base.cc:1034] running on GCE node
I20260808 14:44:14.890408 26881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:14.890625 26881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:14.891726 26881 hybrid_clock.cc:648] HybridClock initialized: now 1786200254891713 us; error 26 us; skew 500 ppm
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:14.894325 26881 init.cc:377] Logged in from keytab as kudu/127.29.168.195@KRBTEST.COM (short username kudu)
I20260808 14:44:14.894838 26881 webserver.cc:460] Webserver started at http://127.29.168.195:39303/ using document root <none> and password file <none>
I20260808 14:44:14.895102 26881 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:14.895151 26881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:14.895256 26881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:14.896296 26881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "805440ee8d244dbe8b26abbc4b9af878"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "3449fd323f149ff92a71f8cf5466b2fc"
server_key_iv: "3726726ba8733efb30f7b845f333fb2f"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.896600 26881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "805440ee8d244dbe8b26abbc4b9af878"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "3449fd323f149ff92a71f8cf5466b2fc"
server_key_iv: "3726726ba8733efb30f7b845f333fb2f"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.897913 26881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:14.898604 26899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.898777 26881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:14.898867 26881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "805440ee8d244dbe8b26abbc4b9af878"
format_stamp: "Formatted at 2026-08-08 14:44:14 on dist-test-slave-mjjr"
server_key: "3449fd323f149ff92a71f8cf5466b2fc"
server_key_iv: "3726726ba8733efb30f7b845f333fb2f"
server_key_version: "encryptionkey@0"
I20260808 14:44:14.898913 26881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:14.924242 26881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:14.925936 26881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:14.926036 26881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:14.926188 26881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:14.926558 26881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:14.926611 26881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.926651 26881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:14.926678 26881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:14.932395 26881 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:43331
I20260808 14:44:14.932433 27053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:43331 every 8 connection(s)
I20260808 14:44:14.932750 26881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:44:14 dist-test-slave-mjjr krb5kdc[26331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200254, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.195@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:14.939237 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 26881
I20260808 14:44:14.939383 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:14.939605 30371 external_mini_cluster.cc:1428] Setting key 1e63d718153eb5d3005bd2e57e4c98d6
I20260808 14:44:14.941769 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.933431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:35011 (local address 127.29.168.254:39975)
0808 14:44:14.933520 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.933522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.933725 (+ 203us) server_negotiation.cc:407] Connection header received
0808 14:44:14.934144 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.934145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.934154 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.934204 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:14.935059 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.935542 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.936504 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.936687 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.936740 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.938776 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:14.938777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:14.938778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:14.938784 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:14.940476 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.940845 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.940846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.940846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.940900 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.941153 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.941154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.941155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.941271 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:14.941342 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.941600 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.941675 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:44:14.941927 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.933381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39975 (local address 127.29.168.195:35011)
0808 14:44:14.933595 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:14.933638 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:14.934064 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:14.934257 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:14.934260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:14.934811 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:14.934980 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.934984 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.935621 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.935622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.936428 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.936430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.936764 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.936765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.936859 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.937252 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:14.937261 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:14.938697 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:14.940550 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:14.940557 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:14.940559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:14.940769 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:14.940975 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:14.940976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:14.940977 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:14.941081 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:14.941334 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:14.941341 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:14.941469 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 14:44:14.941565 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:44:14.941703 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":125,"threads_started":1}
I20260808 14:44:14.942301 27054 heartbeater.cc:347] Connected to a master server at 127.29.168.254:39975
I20260808 14:44:14.942404 27054 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:14.942567 27054 heartbeater.cc:511] Master 127.29.168.254:39975 requested a full tablet report, sending...
I20260808 14:44:14.942962 26398 ts_manager.cc:194] Registered new tserver with Master: 805440ee8d244dbe8b26abbc4b9af878 (127.29.168.195:43331)
I20260808 14:44:14.943347 26398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.168.195@KRBTEST.COM'} at 127.29.168.195:35011
I20260808 14:44:14.951607 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:14.957991 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.952914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52610 (local address 127.29.168.254:39975)
0808 14:44:14.952974 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.952976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.953108 (+ 132us) server_negotiation.cc:407] Connection header received
0808 14:44:14.953144 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.953145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.953153 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.953196 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:14.953661 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.954080 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.954724 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.954885 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.954930 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.955897 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:14.955898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:14.955899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:14.955904 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:14.957166 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.957436 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.957437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.957437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.957481 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:14.957621 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:14.957622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:14.957622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:14.957719 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:14.957782 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.957851 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.957902 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:44:14.959349 26398 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52610:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:14.961179 26398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:14.968369 27067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.964369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53814 (local address 127.29.168.195:43331)
0808 14:44:14.964545 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.964550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.964827 (+ 277us) server_negotiation.cc:407] Connection header received
0808 14:44:14.964904 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.964906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.964921 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.964995 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:14.965126 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.965962 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.967259 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.967963 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.968049 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.968100 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.968252 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.968290 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260808 14:44:14.968357 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.964239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:43331 (local address 127.0.0.1:53814)
0808 14:44:14.964759 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:14.964767 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:14.964819 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:14.964995 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:14.964996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:14.964998 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:14.965044 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.965045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.966063 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.966064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.967162 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.967165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.968047 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.968048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.968125 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.968137 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:44:14.968234 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:44:14.968295 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":59,"threads_started":1}
I20260808 14:44:14.968760 27069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.964378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.29.168.194:38101)
0808 14:44:14.964694 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.964698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.964708 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:14.964752 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.964754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.964766 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.964864 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:14.965091 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.966311 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.967470 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.968167 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.968235 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.968282 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.968650 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.968690 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":78,"threads_started":1}
I20260808 14:44:14.968765 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.964434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55956 (local address 127.29.168.193:35357)
0808 14:44:14.964982 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:14.964987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:14.964997 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:14.965036 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:14.965038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:14.965055 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:14.965276 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:14.965385 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.966452 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.967768 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.968434 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.968535 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.968582 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:14.968662 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:44:14.968697 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":101,"threads_started":1}
I20260808 14:44:14.968775 27065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.964208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:35357 (local address 127.0.0.1:55956)
0808 14:44:14.964563 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:14.964603 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:14.964669 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:14.965155 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:14.965156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:14.965159 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:14.965201 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.965203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.966571 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.966572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.967633 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.967680 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.968545 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.968546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.968599 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.968602 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:14.968654 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:44:14.968691 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":1,"thread_start_us":67,"threads_started":1}
I20260808 14:44:14.968587 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:14.964208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38101 (local address 127.0.0.1:50138)
0808 14:44:14.964563 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:14.964603 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:14.964669 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:14.964882 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:14.964885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:14.964887 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:14.964951 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.964953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.966425 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.966426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.967377 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:14.967380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:14.968330 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:14.968332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:14.968405 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:14.968409 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:14.968464 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:44:14.968523 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":62,"threads_started":1}
I20260808 14:44:14.969332 26961 tablet_service.cc:1467] Processing CreateTablet for tablet de5474ee476c478181a0ea4798a39c24 (DEFAULT_TABLE table=test-table [id=260142a259dc49d1bba840486690c180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:14.969386 26588 tablet_service.cc:1467] Processing CreateTablet for tablet de5474ee476c478181a0ea4798a39c24 (DEFAULT_TABLE table=test-table [id=260142a259dc49d1bba840486690c180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:14.969590 26961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5474ee476c478181a0ea4798a39c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:14.969700 26588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5474ee476c478181a0ea4798a39c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:14.969779 26786 tablet_service.cc:1467] Processing CreateTablet for tablet de5474ee476c478181a0ea4798a39c24 (DEFAULT_TABLE table=test-table [id=260142a259dc49d1bba840486690c180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:14.970047 26786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5474ee476c478181a0ea4798a39c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:14.971773 27071 tablet_bootstrap.cc:492] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Bootstrap starting.
I20260808 14:44:14.972355 27071 tablet_bootstrap.cc:654] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:14.972811 27071 log.cc:824] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:14.973380 27073 tablet_bootstrap.cc:492] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Bootstrap starting.
I20260808 14:44:14.973594 27071 tablet_bootstrap.cc:492] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: No bootstrap required, opened a new log
I20260808 14:44:14.973667 27071 ts_tablet_manager.cc:1397] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:14.973973 27073 tablet_bootstrap.cc:654] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:14.974468 27073 log.cc:824] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:14.974794 27072 tablet_bootstrap.cc:492] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7: Bootstrap starting.
I20260808 14:44:14.975145 27073 tablet_bootstrap.cc:492] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: No bootstrap required, opened a new log
I20260808 14:44:14.975219 27073 ts_tablet_manager.cc:1397] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:14.975394 27072 tablet_bootstrap.cc:654] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:14.975963 27072 log.cc:824] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:14.975775 27071 raft_consensus.cc:348] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:14.976235 27071 raft_consensus.cc:374] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:14.976284 27071 raft_consensus.cc:729] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805440ee8d244dbe8b26abbc4b9af878, State: Initialized, Role: FOLLOWER
I20260808 14:44:14.976404 27071 consensus_queue.cc:260] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:14.976691 27071 ts_tablet_manager.cc:1428] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:14.976698 27054 heartbeater.cc:503] Master 127.29.168.254:39975 was elected leader, sending a full tablet report...
I20260808 14:44:14.976907 27072 tablet_bootstrap.cc:492] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7: No bootstrap required, opened a new log
I20260808 14:44:14.976948 27072 ts_tablet_manager.cc:1397] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:14.977211 27073 raft_consensus.cc:348] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:14.977371 27073 raft_consensus.cc:374] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:14.977413 27073 raft_consensus.cc:729] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533b042977724dcc9ae4bb996a78856c, State: Initialized, Role: FOLLOWER
I20260808 14:44:14.977527 27073 consensus_queue.cc:260] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:14.977810 27073 ts_tablet_manager.cc:1428] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:14.977821 26876 heartbeater.cc:503] Master 127.29.168.254:39975 was elected leader, sending a full tablet report...
I20260808 14:44:14.978823 27072 raft_consensus.cc:348] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:14.978940 27072 raft_consensus.cc:374] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:14.978957 27072 raft_consensus.cc:729] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77251985e78742728b47d983025e63f7, State: Initialized, Role: FOLLOWER
I20260808 14:44:14.979018 27072 consensus_queue.cc:260] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:14.979187 27072 ts_tablet_manager.cc:1428] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:44:14.979257 26686 heartbeater.cc:503] Master 127.29.168.254:39975 was elected leader, sending a full tablet report...
W20260808 14:44:15.025933 26877 tablet.cc:2369] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:44:15.071246 27078 raft_consensus.cc:482] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:15.071357 27078 raft_consensus.cc:504] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:15.071846 27078 leader_election.cc:288] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 805440ee8d244dbe8b26abbc4b9af878 (127.29.168.195:43331), 77251985e78742728b47d983025e63f7 (127.29.168.193:35357)
I20260808 14:44:15.074681 27067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.072167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:59105 (local address 127.29.168.195:43331)
0808 14:44:15.072228 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.072229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.072236 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:44:15.072258 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.072259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.072266 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.072315 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.072515 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.072978 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.073922 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.074362 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.074443 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.074451 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.074592 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.074624 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:44:15.074681 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.072022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:43331 (local address 127.29.168.194:59105)
0808 14:44:15.072078 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.072090 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.072132 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.072345 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.072346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.072348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.072442 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.072445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.073077 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.073078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.073828 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.073830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.074441 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.074442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.074516 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.074518 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.074576 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.074614 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":47}
I20260808 14:44:15.074750 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.072139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:49195 (local address 127.29.168.193:35357)
0808 14:44:15.072366 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.072368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.072374 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:44:15.072394 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.072395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.072401 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.072439 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.072619 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.073099 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.073985 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.074412 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.074492 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.074500 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.074630 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.074664 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260808 14:44:15.074815 27080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.072028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:35357 (local address 127.29.168.194:49195)
0808 14:44:15.072230 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.072239 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.072283 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.072469 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.072470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.072471 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.072532 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.072533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.073186 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.073187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.073897 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.073899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.074492 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.074493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.074559 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.074563 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.074624 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.074660 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":11,"thread_start_us":120,"threads_started":1}
I20260808 14:44:15.075057 26987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5474ee476c478181a0ea4798a39c24" candidate_uuid: "533b042977724dcc9ae4bb996a78856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805440ee8d244dbe8b26abbc4b9af878" is_pre_election: true
I20260808 14:44:15.075202 26987 raft_consensus.cc:2454] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533b042977724dcc9ae4bb996a78856c in term 0.
I20260808 14:44:15.075431 26611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5474ee476c478181a0ea4798a39c24" candidate_uuid: "533b042977724dcc9ae4bb996a78856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77251985e78742728b47d983025e63f7" is_pre_election: true
I20260808 14:44:15.075465 26714 leader_election.cc:302] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533b042977724dcc9ae4bb996a78856c, 805440ee8d244dbe8b26abbc4b9af878; no voters:
I20260808 14:44:15.075574 26611 raft_consensus.cc:2454] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533b042977724dcc9ae4bb996a78856c in term 0.
I20260808 14:44:15.075582 27078 raft_consensus.cc:2781] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:44:15.075665 27078 raft_consensus.cc:482] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:44:15.075697 27078 raft_consensus.cc:3037] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.076373 27078 raft_consensus.cc:504] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:15.076502 27078 leader_election.cc:288] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [CANDIDATE]: Term 1 election: Requested vote from peers 805440ee8d244dbe8b26abbc4b9af878 (127.29.168.195:43331), 77251985e78742728b47d983025e63f7 (127.29.168.193:35357)
I20260808 14:44:15.076642 26987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5474ee476c478181a0ea4798a39c24" candidate_uuid: "533b042977724dcc9ae4bb996a78856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805440ee8d244dbe8b26abbc4b9af878"
I20260808 14:44:15.076663 26611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5474ee476c478181a0ea4798a39c24" candidate_uuid: "533b042977724dcc9ae4bb996a78856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77251985e78742728b47d983025e63f7"
I20260808 14:44:15.076720 26987 raft_consensus.cc:3037] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.076720 26611 raft_consensus.cc:3037] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.077543 26987 raft_consensus.cc:2454] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533b042977724dcc9ae4bb996a78856c in term 1.
I20260808 14:44:15.077543 26611 raft_consensus.cc:2454] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533b042977724dcc9ae4bb996a78856c in term 1.
I20260808 14:44:15.077745 26712 leader_election.cc:302] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533b042977724dcc9ae4bb996a78856c, 77251985e78742728b47d983025e63f7; no voters:
I20260808 14:44:15.077862 27078 raft_consensus.cc:2781] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:15.078038 27078 raft_consensus.cc:686] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 1 LEADER]: Becoming Leader. State: Replica: 533b042977724dcc9ae4bb996a78856c, State: Running, Role: LEADER
I20260808 14:44:15.078147 27078 consensus_queue.cc:237] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } }
I20260808 14:44:15.078918 26398 catalog_manager.cc:5495] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c reported cstate change: term changed from 0 to 1, leader changed from <none> to 533b042977724dcc9ae4bb996a78856c (127.29.168.194). New cstate: current_term: 1 leader_uuid: "533b042977724dcc9ae4bb996a78856c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "533b042977724dcc9ae4bb996a78856c" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 } health_report { overall_health: UNKNOWN } } }
I20260808 14:44:15.085659 27069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.083724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50152 (local address 127.29.168.194:38101)
0808 14:44:15.083796 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.083798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.083804 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:44:15.083845 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.083846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.083858 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.083908 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:15.084002 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.084388 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.085028 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.085200 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.085243 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.085367 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:15.085441 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:15.085492 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.085523 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.085537 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:44:15.087252 26987 raft_consensus.cc:1261] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 1 FOLLOWER]: Refusing update from remote peer 533b042977724dcc9ae4bb996a78856c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:15.087252 26611 raft_consensus.cc:1261] T de5474ee476c478181a0ea4798a39c24 P 77251985e78742728b47d983025e63f7 [term 1 FOLLOWER]: Refusing update from remote peer 533b042977724dcc9ae4bb996a78856c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:15.087610 27081 consensus_queue.cc:1035] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [LEADER]: Connected to new peer: Peer: permanent_uuid: "77251985e78742728b47d983025e63f7" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:15.087783 27078 consensus_queue.cc:1035] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805440ee8d244dbe8b26abbc4b9af878" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 43331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:15.089684 27084 mvcc.cc:205] Tried to move back new op lower bound from 7316276244834910208 to 7316276244800651264. Current Snapshot: MvccSnapshot[applied={T|T < 7316276244834910208}]
I20260808 14:44:15.091779 26398 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:15.091871 26398 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:15.092386 27089 mvcc.cc:205] Tried to move back new op lower bound from 7316276244834910208 to 7316276244800651264. Current Snapshot: MvccSnapshot[applied={T|T < 7316276244834910208}]
I20260808 14:44:15.092638 26398 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e9a3565961a4d808aa10fa951799622: Sending DeleteTablet for 3 replicas of tablet de5474ee476c478181a0ea4798a39c24
I20260808 14:44:15.092998 26588 tablet_service.cc:1514] Processing DeleteTablet for tablet de5474ee476c478181a0ea4798a39c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:55956
I20260808 14:44:15.093040 26786 tablet_service.cc:1514] Processing DeleteTablet for tablet de5474ee476c478181a0ea4798a39c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:50138
I20260808 14:44:15.093075 26785 tablet_service.cc:1514] Processing DeleteTablet for tablet de5474ee476c478181a0ea4798a39c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:50138
I20260808 14:44:15.093272 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 26493
I20260808 14:44:15.093365 26961 tablet_service.cc:1514] Processing DeleteTablet for tablet de5474ee476c478181a0ea4798a39c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='kudu', principal='kudu/127.29.168.254@KRBTEST.COM'} at 127.0.0.1:53814
I20260808 14:44:15.093523 27096 tablet_replica.cc:330] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: stopping tablet replica
I20260808 14:44:15.093585 27096 raft_consensus.cc:2229] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:15.093648 27096 raft_consensus.cc:2258] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:15.098409 27096 ts_tablet_manager.cc:1905] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:15.100149 27096 ts_tablet_manager.cc:1918] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:15.100207 27096 log.cc:1196] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/de5474ee476c478181a0ea4798a39c24
I20260808 14:44:15.100445 27096 ts_tablet_manager.cc:1939] T de5474ee476c478181a0ea4798a39c24 P 805440ee8d244dbe8b26abbc4b9af878: Deleting consensus metadata
I20260808 14:44:15.100998 26381 catalog_manager.cc:4841] TS 805440ee8d244dbe8b26abbc4b9af878 (127.29.168.195:43331): tablet de5474ee476c478181a0ea4798a39c24 (table test-table [id=260142a259dc49d1bba840486690c180]) successfully deleted
I20260808 14:44:15.104010 27095 tablet_replica.cc:330] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: stopping tablet replica
I20260808 14:44:15.104110 27095 raft_consensus.cc:2229] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:44:15.104193 27095 raft_consensus.cc:2258] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:15.108873 27095 ts_tablet_manager.cc:1905] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:15.110073 27095 ts_tablet_manager.cc:1918] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:15.110131 27095 log.cc:1196] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/de5474ee476c478181a0ea4798a39c24
I20260808 14:44:15.110380 27095 ts_tablet_manager.cc:1939] T de5474ee476c478181a0ea4798a39c24 P 533b042977724dcc9ae4bb996a78856c: Deleting consensus metadata
I20260808 14:44:15.110832 26377 catalog_manager.cc:4841] TS 533b042977724dcc9ae4bb996a78856c (127.29.168.194:38101): tablet de5474ee476c478181a0ea4798a39c24 (table test-table [id=260142a259dc49d1bba840486690c180]) successfully deleted
W20260808 14:44:15.110996 26377 catalog_manager.cc:4808] TS 533b042977724dcc9ae4bb996a78856c (127.29.168.194:38101): delete failed for tablet de5474ee476c478181a0ea4798a39c24 because the tablet was not found. No further retry: Not found: Tablet not found: de5474ee476c478181a0ea4798a39c24
W20260808 14:44:15.112932 26379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:35357 (error 108)
I20260808 14:44:15.113471 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.113332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:35357 (local address 127.0.0.1:55960)
0808 14:44:15.113392 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.113432 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:35357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:44:15.113582 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 26692
W20260808 14:44:15.117794 26379 catalog_manager.cc:4584] TS 77251985e78742728b47d983025e63f7 (127.29.168.193:35357): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet de5474ee476c478181a0ea4798a39c24: Network error: Client connection negotiation failed: client connection to 127.29.168.193:35357: connect: Connection refused (error 111)
I20260808 14:44:15.122556 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 26881
I20260808 14:44:15.133140 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 26353
2026-08-08T14:44:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2090 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T14:44:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:15Z Disabled control of system clock
I20260808 14:44:15.163223 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44161
--webserver_interface=127.29.168.254
--webserver_port=0
--builtin_ntp_servers=127.29.168.212:41141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:44161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:15.241701 27105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:15.241922 27105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:15.241942 27105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:15.243058 27105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:15.243109 27105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:15.243134 27105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:15.243170 27105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:15.243196 27105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:15.244436 27105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:44161
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:44161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:15.244675 27105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:15.244994 27105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:15.249395 27121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.249420 27124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.249411 27119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:15.249666 27105 server_base.cc:1034] running on GCE node
I20260808 14:44:15.249899 27105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:15.250180 27105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:15.251312 27105 hybrid_clock.cc:648] HybridClock initialized: now 1786200255251307 us; error 29 us; skew 500 ppm
I20260808 14:44:15.252455 27105 webserver.cc:460] Webserver started at http://127.29.168.254:44467/ using document root <none> and password file <none>
I20260808 14:44:15.252712 27105 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:15.252758 27105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:15.252909 27105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:15.253839 27105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "5fad39ff64004c07ad9b7d1a68c297ac"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "c4bd3d2e2d0e63613032cf4455ac6038"
server_key_iv: "6a31c19fdc7996267ac28ed522bec641"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.254160 27105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "5fad39ff64004c07ad9b7d1a68c297ac"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "c4bd3d2e2d0e63613032cf4455ac6038"
server_key_iv: "6a31c19fdc7996267ac28ed522bec641"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.255374 27105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:15.256170 27132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.256341 27105 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.256433 27105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "5fad39ff64004c07ad9b7d1a68c297ac"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "c4bd3d2e2d0e63613032cf4455ac6038"
server_key_iv: "6a31c19fdc7996267ac28ed522bec641"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.256520 27105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:15.270112 27105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:15.270360 27105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:15.270494 27105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:15.274432 27105 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:44161
I20260808 14:44:15.274466 27203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:44161 every 8 connection(s)
I20260808 14:44:15.274757 27105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:15.275799 27204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:15.277601 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 27105
I20260808 14:44:15.277742 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:15.277971 30371 external_mini_cluster.cc:1428] Setting key ee9717040724494b1a18e56e7f864a12
I20260808 14:44:15.278352 27204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac: Bootstrap starting.
I20260808 14:44:15.278971 27204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:15.279296 27204 log.cc:824] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:15.280032 27204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac: No bootstrap required, opened a new log
I20260808 14:44:15.282137 27204 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44161 } }
I20260808 14:44:15.282343 27204 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:15.282419 27204 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fad39ff64004c07ad9b7d1a68c297ac, State: Initialized, Role: FOLLOWER
I20260808 14:44:15.282558 27204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44161 } }
I20260808 14:44:15.282648 27204 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:15.282688 27204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:15.282747 27204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.283376 27204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44161 } }
I20260808 14:44:15.283393 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.278454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37060 (local address 127.29.168.254:44161)
0808 14:44:15.278659 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.278669 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.278698 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:44:15.279114 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.279121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.279193 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.279295 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:15.279578 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.280543 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.281574 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.281932 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.282014 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.282728 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:15.282732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:15.282732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:15.282922 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:15.282952 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:15.282962 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:15.283013 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.283137 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.283221 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":106,"threads_started":1}
I20260808 14:44:15.283499 27204 leader_election.cc:302] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fad39ff64004c07ad9b7d1a68c297ac; no voters:
I20260808 14:44:15.283707 27204 leader_election.cc:288] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:15.283747 27212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:15.283902 27212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [term 1 LEADER]: Becoming Leader. State: Replica: 5fad39ff64004c07ad9b7d1a68c297ac, State: Running, Role: LEADER
I20260808 14:44:15.283943 27204 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:15.283990 27212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44161 } }
I20260808 14:44:15.284260 27212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fad39ff64004c07ad9b7d1a68c297ac. Latest consensus state: current_term: 1 leader_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44161 } } }
I20260808 14:44:15.284338 27212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:15.284274 27214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fad39ff64004c07ad9b7d1a68c297ac" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 44161 } } }
I20260808 14:44:15.284475 27214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:15.284847 27219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:15.285316 27219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:15.286796 27219 catalog_manager.cc:1347] Generated new cluster ID: bb0d4359262e41739500edc8f8a55b48
I20260808 14:44:15.286840 27219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:15.300832 27219 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:15.301318 27219 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:15.314263 27219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac: Generated new TSK 0
I20260808 14:44:15.314419 27219 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:15.320181 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.193:0
--local_ip_for_outbound_sockets=127.29.168.193
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44161
--builtin_ntp_servers=127.29.168.212:41141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:44:15.400883 27236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:15.401062 27236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:15.401081 27236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:15.402194 27236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:15.402233 27236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:15.402283 27236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.193
I20260808 14:44:15.403626 27236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.168.193
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.193
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:15.403878 27236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:15.404181 27236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:15.409080 27244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.409096 27247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:15.409369 27236 server_base.cc:1034] running on GCE node
W20260808 14:44:15.409088 27245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:15.409605 27236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:15.409868 27236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:15.411048 27236 hybrid_clock.cc:648] HybridClock initialized: now 1786200255411036 us; error 28 us; skew 500 ppm
I20260808 14:44:15.412268 27236 webserver.cc:460] Webserver started at http://127.29.168.193:40729/ using document root <none> and password file <none>
I20260808 14:44:15.412525 27236 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:15.412595 27236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:15.412747 27236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:15.413724 27236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data/instance:
uuid: "8b68543336054eaf9eb563d9b8a6cb2c"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "3c551822498ec8ad1554e92e80f20b90"
server_key_iv: "f66c18235add80287801a7fd84b010c2"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.414171 27236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance:
uuid: "8b68543336054eaf9eb563d9b8a6cb2c"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "3c551822498ec8ad1554e92e80f20b90"
server_key_iv: "f66c18235add80287801a7fd84b010c2"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.415411 27236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:44:15.416126 27255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.416296 27236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.416380 27236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal
uuid: "8b68543336054eaf9eb563d9b8a6cb2c"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "3c551822498ec8ad1554e92e80f20b90"
server_key_iv: "f66c18235add80287801a7fd84b010c2"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.416451 27236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:15.428138 27236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:15.428392 27236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:15.428536 27236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:15.428761 27236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:15.429059 27236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:15.429133 27236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.429170 27236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:15.429196 27236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.435106 27236 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.193:36331
I20260808 14:44:15.435153 27409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.193:36331 every 8 connection(s)
I20260808 14:44:15.435482 27236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/data/info.pb
I20260808 14:44:15.435616 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 27236
I20260808 14:44:15.435786 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:15.436015 30371 external_mini_cluster.cc:1428] Setting key 167f320863a4e2873f7ec304aad821ba
I20260808 14:44:15.437110 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.194:0
--local_ip_for_outbound_sockets=127.29.168.194
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44161
--builtin_ntp_servers=127.29.168.212:41141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:44:15.441445 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.436388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.193:58797 (local address 127.29.168.254:44161)
0808 14:44:15.436454 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.436456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.436683 (+ 227us) server_negotiation.cc:407] Connection header received
0808 14:44:15.437166 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.437167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.437180 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.437245 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:15.437930 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.438662 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.440172 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.440356 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.440411 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.441198 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:15.441199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:15.441200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:15.441203 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:15.441215 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:15.441219 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:15.441260 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.441371 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.441391 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:44:15.441741 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.436304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44161 (local address 127.29.168.193:58797)
0808 14:44:15.436543 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.436570 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.437070 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.437370 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.437374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.437385 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:15.437843 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.437847 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.438765 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.438766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.440090 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.440093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.440441 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.440443 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.440593 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.441044 (+ 451us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:15.441045 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:15.441078 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:15.441105 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:15.441281 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:15.441289 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:15.441292 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.441367 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.441472 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":114,"threads_started":1}
I20260808 14:44:15.442323 27410 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44161
I20260808 14:44:15.442413 27410 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:15.442600 27410 heartbeater.cc:511] Master 127.29.168.254:44161 requested a full tablet report, sending...
I20260808 14:44:15.443094 27156 ts_manager.cc:194] Registered new tserver with Master: 8b68543336054eaf9eb563d9b8a6cb2c (127.29.168.193:36331)
I20260808 14:44:15.443768 27156 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.193:58797
W20260808 14:44:15.518378 27413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:15.518621 27413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:15.518647 27413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:15.519896 27413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:15.519933 27413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:15.519977 27413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.194
I20260808 14:44:15.521378 27413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.168.194
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.194
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:15.521593 27413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:15.521895 27413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:15.526711 27420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.526759 27418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.526759 27425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:15.526927 27413 server_base.cc:1034] running on GCE node
I20260808 14:44:15.527166 27413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:15.527393 27413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:15.528548 27413 hybrid_clock.cc:648] HybridClock initialized: now 1786200255528538 us; error 37 us; skew 500 ppm
I20260808 14:44:15.529790 27413 webserver.cc:460] Webserver started at http://127.29.168.194:33999/ using document root <none> and password file <none>
I20260808 14:44:15.530014 27413 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:15.530076 27413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:15.530205 27413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:15.531158 27413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data/instance:
uuid: "bec470af756542448befc4840a48ded7"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "9e8f05c1c5db3d0d75b9d0dc43890348"
server_key_iv: "93ea83fdc2ef01bf4a1b3d855b8ab822"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.531507 27413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance:
uuid: "bec470af756542448befc4840a48ded7"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "9e8f05c1c5db3d0d75b9d0dc43890348"
server_key_iv: "93ea83fdc2ef01bf4a1b3d855b8ab822"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.532858 27413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:15.533623 27431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.533825 27413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:15.533900 27413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal
uuid: "bec470af756542448befc4840a48ded7"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "9e8f05c1c5db3d0d75b9d0dc43890348"
server_key_iv: "93ea83fdc2ef01bf4a1b3d855b8ab822"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.533986 27413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:15.553723 27413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:15.553972 27413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:15.554100 27413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:15.554301 27413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:15.554592 27413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:15.554625 27413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.554670 27413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:15.554697 27413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.560411 27413 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.194:38295
I20260808 14:44:15.560465 27596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.194:38295 every 8 connection(s)
I20260808 14:44:15.560791 27413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/data/info.pb
I20260808 14:44:15.563190 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 27413
I20260808 14:44:15.563302 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:15.563494 30371 external_mini_cluster.cc:1428] Setting key b4a52febeff117275f93faf669a32962
I20260808 14:44:15.564625 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.168.195:0
--local_ip_for_outbound_sockets=127.29.168.195
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44161
--builtin_ntp_servers=127.29.168.212:41141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:44:15.566303 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.561439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.194:50253 (local address 127.29.168.254:44161)
0808 14:44:15.561494 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.561496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.561710 (+ 214us) server_negotiation.cc:407] Connection header received
0808 14:44:15.562189 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.562190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.562202 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.562262 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:15.562898 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.563706 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.564887 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.565103 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.565178 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.565981 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:15.565983 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:15.565983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:15.565988 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:15.566002 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:15.566006 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:15.566049 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.566160 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.566188 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:44:15.566771 27600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.561435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44161 (local address 127.29.168.194:50253)
0808 14:44:15.561607 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.561634 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.562087 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.562329 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.562332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.562340 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:15.562788 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.562792 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.563819 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.563820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.564774 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.564777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.565186 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.565187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.565317 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.565832 (+ 515us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:15.565832 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:15.565857 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:15.565877 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:15.566059 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:15.566064 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:15.566067 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.566404 (+ 337us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.566541 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260808 14:44:15.567251 27597 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44161
I20260808 14:44:15.567346 27597 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:15.567528 27597 heartbeater.cc:511] Master 127.29.168.254:44161 requested a full tablet report, sending...
I20260808 14:44:15.567927 27156 ts_manager.cc:194] Registered new tserver with Master: bec470af756542448befc4840a48ded7 (127.29.168.194:38295)
I20260808 14:44:15.568286 27156 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.194:50253
W20260808 14:44:15.644434 27602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:15.644634 27602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:15.644666 27602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:15.645757 27602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:15.645821 27602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:15.645860 27602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.168.195
I20260808 14:44:15.647220 27602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:41141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.168.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.168.195
--webserver_port=0
--tserver_master_addrs=127.29.168.254:44161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.168.195
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:15.647486 27602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:15.647794 27602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:15.652624 27613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.652653 27610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:15.652653 27609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:15.652783 27602 server_base.cc:1034] running on GCE node
I20260808 14:44:15.653016 27602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:15.653275 27602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:15.654419 27602 hybrid_clock.cc:648] HybridClock initialized: now 1786200255654406 us; error 30 us; skew 500 ppm
I20260808 14:44:15.655771 27602 webserver.cc:460] Webserver started at http://127.29.168.195:38871/ using document root <none> and password file <none>
I20260808 14:44:15.656059 27602 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:15.656108 27602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:15.656258 27602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:15.657239 27602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data/instance:
uuid: "465dca7b9a9948e08db718fa6820fc68"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "67b847f43288ae6ddc0b9dbfc37aa9ba"
server_key_iv: "315ccca388345c66d55efdd063992f4d"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.657569 27602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance:
uuid: "465dca7b9a9948e08db718fa6820fc68"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "67b847f43288ae6ddc0b9dbfc37aa9ba"
server_key_iv: "315ccca388345c66d55efdd063992f4d"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.658972 27602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:15.659734 27625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.659897 27602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:15.659991 27602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal
uuid: "465dca7b9a9948e08db718fa6820fc68"
format_stamp: "Formatted at 2026-08-08 14:44:15 on dist-test-slave-mjjr"
server_key: "67b847f43288ae6ddc0b9dbfc37aa9ba"
server_key_iv: "315ccca388345c66d55efdd063992f4d"
server_key_version: "encryptionkey@0"
I20260808 14:44:15.660076 27602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:15.677606 27602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:15.677875 27602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:15.678015 27602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:15.678215 27602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:15.678514 27602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:15.678563 27602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.678596 27602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:15.678646 27602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:15.684389 27602 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.195:42547
I20260808 14:44:15.684460 27780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.195:42547 every 8 connection(s)
I20260808 14:44:15.684751 27602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/data/info.pb
I20260808 14:44:15.689749 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.685477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:47731 (local address 127.29.168.254:44161)
0808 14:44:15.685519 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.685520 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.685729 (+ 209us) server_negotiation.cc:407] Connection header received
0808 14:44:15.686259 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.686261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.686273 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.686318 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:15.687019 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.687514 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.688498 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.688704 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.688778 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.689487 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:15.689489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:15.689489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:15.689494 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:15.689509 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:15.689513 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:15.689554 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.689649 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.689675 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:44:15.689939 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.685448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:44161 (local address 127.29.168.195:47731)
0808 14:44:15.685614 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.685654 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.686145 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.686395 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.686398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.686407 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:15.686916 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.686921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.687611 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.687612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.688394 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.688396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.688788 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.688789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.688923 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.689348 (+ 425us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:44:15.689348 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:15.689371 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:44:15.689391 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:15.689565 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:15.689569 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:15.689572 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.689652 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.689740 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
I20260808 14:44:15.690444 27782 heartbeater.cc:347] Connected to a master server at 127.29.168.254:44161
I20260808 14:44:15.690513 27782 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:15.690716 27782 heartbeater.cc:511] Master 127.29.168.254:44161 requested a full tablet report, sending...
I20260808 14:44:15.690768 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 27602
I20260808 14:44:15.690883 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:15.691089 27156 ts_manager.cc:194] Registered new tserver with Master: 465dca7b9a9948e08db718fa6820fc68 (127.29.168.195:42547)
I20260808 14:44:15.691130 30371 external_mini_cluster.cc:1428] Setting key 4d926dde18a28447f621b795e9508390
I20260808 14:44:15.691495 27156 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.168.195:47731
I20260808 14:44:15.692113 30371 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:15.695784 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.693460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37996 (local address 127.29.168.254:44161)
0808 14:44:15.693511 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.693512 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.693637 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:44:15.693671 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.693671 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.693678 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.693721 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:15.693843 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.694216 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.694844 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.694991 (+ 147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.695034 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.695523 (+ 489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:15.695524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:15.695525 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:15.695528 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:15.695538 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:15.695541 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:15.695576 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.695613 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.695628 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:44:15.697019 27156 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:15.698484 27156 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:15.704268 27792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.700469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.195:42547 (local address 127.0.0.1:58726)
0808 14:44:15.700608 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.700642 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.700704 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.700960 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.700963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.700966 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.701024 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.701026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.702183 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.702184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.703109 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.703112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.704073 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.704074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.704126 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.704136 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.704188 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.704221 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260808 14:44:15.704324 27794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.700572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58726 (local address 127.29.168.195:42547)
0808 14:44:15.700744 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.700748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.700760 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:44:15.700797 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.700799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.700814 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.700893 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.701097 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.702086 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.703250 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.703989 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.704076 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.704148 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.704202 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.704246 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
I20260808 14:44:15.704932 27793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.700493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38295 (local address 127.0.0.1:46138)
0808 14:44:15.700918 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.700928 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.700979 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.701217 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.701217 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.701219 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.701261 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.701262 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.702394 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.702395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.703565 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.703567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.704713 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.704714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.704754 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.704757 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.704840 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.704875 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":28,"thread_start_us":90,"threads_started":1}
I20260808 14:44:15.704970 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.700734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46138 (local address 127.29.168.194:38295)
0808 14:44:15.700896 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.700900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.701033 (+ 133us) server_negotiation.cc:407] Connection header received
0808 14:44:15.701073 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.701075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.701088 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.701153 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.701347 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.702312 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.703683 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.704371 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.704453 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.704524 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.704859 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.704896 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260808 14:44:15.704981 27697 tablet_service.cc:1467] Processing CreateTablet for tablet cfaea5c33f164008b6f3dea201420688 (DEFAULT_TABLE table=test-table [id=fba68e533bec4bef8a62eee8d8d36072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:15.705343 27697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfaea5c33f164008b6f3dea201420688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:15.705713 27504 tablet_service.cc:1467] Processing CreateTablet for tablet cfaea5c33f164008b6f3dea201420688 (DEFAULT_TABLE table=test-table [id=fba68e533bec4bef8a62eee8d8d36072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:15.706012 27504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfaea5c33f164008b6f3dea201420688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:15.706032 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.700711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:36331 (local address 127.0.0.1:39318)
0808 14:44:15.700945 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.700953 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.700990 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.701433 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.701434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.701436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.701477 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.701479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.702470 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.702471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.703565 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.703567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.705462 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.705464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.705526 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.705861 (+ 335us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.705913 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.705961 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":9,"thread_start_us":125,"threads_started":1}
I20260808 14:44:15.706254 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.700979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39318 (local address 127.29.168.193:36331)
0808 14:44:15.701168 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.701171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.701181 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:15.701233 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.701234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.701283 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.701362 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.701563 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.702378 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.704561 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.705262 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.705341 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.705419 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.706130 (+ 711us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.706177 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
I20260808 14:44:15.706882 27323 tablet_service.cc:1467] Processing CreateTablet for tablet cfaea5c33f164008b6f3dea201420688 (DEFAULT_TABLE table=test-table [id=fba68e533bec4bef8a62eee8d8d36072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:15.707232 27323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfaea5c33f164008b6f3dea201420688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:15.708668 27799 tablet_bootstrap.cc:492] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Bootstrap starting.
I20260808 14:44:15.709033 27800 tablet_bootstrap.cc:492] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Bootstrap starting.
I20260808 14:44:15.709302 27799 tablet_bootstrap.cc:654] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:15.709589 27799 log.cc:824] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:15.709721 27800 tablet_bootstrap.cc:654] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:15.710041 27800 log.cc:824] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:15.710325 27799 tablet_bootstrap.cc:492] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: No bootstrap required, opened a new log
I20260808 14:44:15.710399 27799 ts_tablet_manager.cc:1397] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:44:15.710816 27804 tablet_bootstrap.cc:492] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c: Bootstrap starting.
I20260808 14:44:15.710950 27800 tablet_bootstrap.cc:492] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: No bootstrap required, opened a new log
I20260808 14:44:15.711027 27800 ts_tablet_manager.cc:1397] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:15.711648 27804 tablet_bootstrap.cc:654] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:15.712028 27804 log.cc:824] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:15.712831 27804 tablet_bootstrap.cc:492] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c: No bootstrap required, opened a new log
I20260808 14:44:15.712903 27804 ts_tablet_manager.cc:1397] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:44:15.712996 27799 raft_consensus.cc:348] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.713161 27799 raft_consensus.cc:374] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:15.713193 27799 raft_consensus.cc:729] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bec470af756542448befc4840a48ded7, State: Initialized, Role: FOLLOWER
I20260808 14:44:15.713337 27799 consensus_queue.cc:260] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.713394 27800 raft_consensus.cc:348] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.713567 27800 raft_consensus.cc:374] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:15.713613 27800 raft_consensus.cc:729] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 465dca7b9a9948e08db718fa6820fc68, State: Initialized, Role: FOLLOWER
I20260808 14:44:15.713644 27799 ts_tablet_manager.cc:1428] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 14:44:15.713749 27597 heartbeater.cc:503] Master 127.29.168.254:44161 was elected leader, sending a full tablet report...
I20260808 14:44:15.713735 27800 consensus_queue.cc:260] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.713976 27800 ts_tablet_manager.cc:1428] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:15.714002 27782 heartbeater.cc:503] Master 127.29.168.254:44161 was elected leader, sending a full tablet report...
I20260808 14:44:15.715421 27804 raft_consensus.cc:348] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.715546 27804 raft_consensus.cc:374] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:15.715566 27804 raft_consensus.cc:729] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b68543336054eaf9eb563d9b8a6cb2c, State: Initialized, Role: FOLLOWER
I20260808 14:44:15.715682 27804 consensus_queue.cc:260] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.715893 27804 ts_tablet_manager.cc:1428] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:44:15.715978 27410 heartbeater.cc:503] Master 127.29.168.254:44161 was elected leader, sending a full tablet report...
I20260808 14:44:15.738982 27808 raft_consensus.cc:482] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:44:15.739044 27808 raft_consensus.cc:504] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.739267 27808 leader_election.cc:288] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b68543336054eaf9eb563d9b8a6cb2c (127.29.168.193:36331), bec470af756542448befc4840a48ded7 (127.29.168.194:38295)
I20260808 14:44:15.741808 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.739478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:50249 (local address 127.29.168.193:36331)
0808 14:44:15.739515 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.739516 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.739526 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:15.739628 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.739629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.739640 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.739715 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.739863 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.740285 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.741167 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.741501 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.741580 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.741587 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.741719 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.741751 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:15.741819 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.739421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:36331 (local address 127.29.168.195:50249)
0808 14:44:15.739468 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.739477 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.739527 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.739718 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.739719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.739721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.739782 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.739783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.740369 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.740370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.741077 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.741079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.741580 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.741580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.741648 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.741650 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.741714 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.741751 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:44:15.742007 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.739484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.168.195:45077 (local address 127.29.168.194:38295)
0808 14:44:15.739584 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.739586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.739650 (+ 64us) server_negotiation.cc:407] Connection header received
0808 14:44:15.739719 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.739720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.739728 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.739779 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:15.739931 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.740353 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.741267 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.741607 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.741697 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.741704 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.741862 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.741912 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 14:44:15.742173 27810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.739447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.194:38295 (local address 127.29.168.195:45077)
0808 14:44:15.739569 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.739579 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:15.739666 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:15.739792 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:15.739793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:15.739794 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:15.739864 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.739866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.740431 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.740432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.741168 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:15.741170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.741700 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.741701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:15.741789 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.741792 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:44:15.741993 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 14:44:15.742034 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260808 14:44:15.742128 27350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaea5c33f164008b6f3dea201420688" candidate_uuid: "465dca7b9a9948e08db718fa6820fc68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" is_pre_election: true
I20260808 14:44:15.742283 27350 raft_consensus.cc:2454] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 465dca7b9a9948e08db718fa6820fc68 in term 0.
I20260808 14:44:15.742493 27531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaea5c33f164008b6f3dea201420688" candidate_uuid: "465dca7b9a9948e08db718fa6820fc68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bec470af756542448befc4840a48ded7" is_pre_election: true
I20260808 14:44:15.742518 27629 leader_election.cc:302] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 465dca7b9a9948e08db718fa6820fc68, 8b68543336054eaf9eb563d9b8a6cb2c; no voters:
I20260808 14:44:15.742583 27531 raft_consensus.cc:2454] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 465dca7b9a9948e08db718fa6820fc68 in term 0.
I20260808 14:44:15.742703 27808 raft_consensus.cc:2781] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:44:15.742771 27808 raft_consensus.cc:482] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:44:15.742803 27808 raft_consensus.cc:3037] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.743378 27808 raft_consensus.cc:504] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.743507 27808 leader_election.cc:288] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [CANDIDATE]: Term 1 election: Requested vote from peers 8b68543336054eaf9eb563d9b8a6cb2c (127.29.168.193:36331), bec470af756542448befc4840a48ded7 (127.29.168.194:38295)
I20260808 14:44:15.743670 27531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaea5c33f164008b6f3dea201420688" candidate_uuid: "465dca7b9a9948e08db718fa6820fc68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bec470af756542448befc4840a48ded7"
I20260808 14:44:15.743683 27350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaea5c33f164008b6f3dea201420688" candidate_uuid: "465dca7b9a9948e08db718fa6820fc68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b68543336054eaf9eb563d9b8a6cb2c"
I20260808 14:44:15.743745 27350 raft_consensus.cc:3037] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.743745 27531 raft_consensus.cc:3037] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:15.744570 27350 raft_consensus.cc:2454] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 465dca7b9a9948e08db718fa6820fc68 in term 1.
I20260808 14:44:15.744571 27531 raft_consensus.cc:2454] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 465dca7b9a9948e08db718fa6820fc68 in term 1.
I20260808 14:44:15.744763 27629 leader_election.cc:302] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 465dca7b9a9948e08db718fa6820fc68, 8b68543336054eaf9eb563d9b8a6cb2c; no voters:
I20260808 14:44:15.744897 27808 raft_consensus.cc:2781] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:15.745060 27808 raft_consensus.cc:686] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 1 LEADER]: Becoming Leader. State: Replica: 465dca7b9a9948e08db718fa6820fc68, State: Running, Role: LEADER
I20260808 14:44:15.745158 27808 consensus_queue.cc:237] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } }
I20260808 14:44:15.745836 27155 catalog_manager.cc:5495] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 465dca7b9a9948e08db718fa6820fc68 (127.29.168.195). New cstate: current_term: 1 leader_uuid: "465dca7b9a9948e08db718fa6820fc68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "465dca7b9a9948e08db718fa6820fc68" member_type: VOTER last_known_addr { host: "127.29.168.195" port: 42547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 } health_report { overall_health: UNKNOWN } } }
I20260808 14:44:15.752219 27794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.749926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58734 (local address 127.29.168.195:42547)
0808 14:44:15.749977 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:15.749979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:15.749987 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:15.750073 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:15.750073 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:15.750089 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:15.750169 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:15.750302 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.750710 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.751427 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:15.751608 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:15.751725 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:15.751899 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:15.752003 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:15.752091 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:15.752113 (+ 22us) server_negotiation.cc:299] Negotiation successful
0808 14:44:15.752130 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:44:15.753724 27531 raft_consensus.cc:1261] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 1 FOLLOWER]: Refusing update from remote peer 465dca7b9a9948e08db718fa6820fc68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:15.753724 27350 raft_consensus.cc:1261] T cfaea5c33f164008b6f3dea201420688 P 8b68543336054eaf9eb563d9b8a6cb2c [term 1 FOLLOWER]: Refusing update from remote peer 465dca7b9a9948e08db718fa6820fc68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:15.754065 27812 consensus_queue.cc:1035] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bec470af756542448befc4840a48ded7" member_type: VOTER last_known_addr { host: "127.29.168.194" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:15.754182 27808 consensus_queue.cc:1035] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b68543336054eaf9eb563d9b8a6cb2c" member_type: VOTER last_known_addr { host: "127.29.168.193" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:15.758090 27155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:15.758188 27155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:44:15.758864 27155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5fad39ff64004c07ad9b7d1a68c297ac: Sending DeleteTablet for 3 replicas of tablet cfaea5c33f164008b6f3dea201420688
I20260808 14:44:15.759186 27504 tablet_service.cc:1514] Processing DeleteTablet for tablet cfaea5c33f164008b6f3dea201420688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='slave'} at 127.0.0.1:46138
I20260808 14:44:15.759224 27697 tablet_service.cc:1514] Processing DeleteTablet for tablet cfaea5c33f164008b6f3dea201420688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='slave'} at 127.0.0.1:58726
I20260808 14:44:15.759398 27833 tablet_replica.cc:330] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: stopping tablet replica
I20260808 14:44:15.759438 27323 tablet_service.cc:1514] Processing DeleteTablet for tablet cfaea5c33f164008b6f3dea201420688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:44:15 UTC) from {username='slave'} at 127.0.0.1:39318
I20260808 14:44:15.759424 27834 tablet_replica.cc:330] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: stopping tablet replica
I20260808 14:44:15.759490 27833 raft_consensus.cc:2229] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:44:15.759568 27833 raft_consensus.cc:2258] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:15.759663 27834 raft_consensus.cc:2229] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:44:15.759750 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 27236
I20260808 14:44:15.759847 27834 raft_consensus.cc:2258] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:44:15.760288 27833 ts_tablet_manager.cc:1905] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:15.760831 27834 ts_tablet_manager.cc:1905] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:44:15.763010 27834 ts_tablet_manager.cc:1918] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:15.763223 27834 log.cc:1196] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-2/wal/wals/cfaea5c33f164008b6f3dea201420688
I20260808 14:44:15.763612 27834 ts_tablet_manager.cc:1939] T cfaea5c33f164008b6f3dea201420688 P 465dca7b9a9948e08db718fa6820fc68: Deleting consensus metadata
I20260808 14:44:15.763726 27833 ts_tablet_manager.cc:1918] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:44:15.763809 27833 log.cc:1196] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Deleting WAL directory at /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200015623817-30371-0/minicluster-data/ts-1/wal/wals/cfaea5c33f164008b6f3dea201420688
I20260808 14:44:15.764068 27833 ts_tablet_manager.cc:1939] T cfaea5c33f164008b6f3dea201420688 P bec470af756542448befc4840a48ded7: Deleting consensus metadata
I20260808 14:44:15.764429 27133 catalog_manager.cc:4841] TS bec470af756542448befc4840a48ded7 (127.29.168.194:38295): tablet cfaea5c33f164008b6f3dea201420688 (table test-table [id=fba68e533bec4bef8a62eee8d8d36072]) successfully deleted
I20260808 14:44:15.771159 27135 catalog_manager.cc:4841] TS 465dca7b9a9948e08db718fa6820fc68 (127.29.168.195:42547): tablet cfaea5c33f164008b6f3dea201420688 (table test-table [id=fba68e533bec4bef8a62eee8d8d36072]) successfully deleted
W20260808 14:44:15.775457 27135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.168.193:36331 (error 108)
I20260808 14:44:15.775749 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 27413
I20260808 14:44:15.776087 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:15.775970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.193:36331 (local address 127.0.0.1:39326)
0808 14:44:15.776018 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:15.776053 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.193:36331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:44:15.776291 27135 catalog_manager.cc:4584] TS 8b68543336054eaf9eb563d9b8a6cb2c (127.29.168.193:36331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cfaea5c33f164008b6f3dea201420688: Network error: Client connection negotiation failed: client connection to 127.29.168.193:36331: connect: Connection refused (error 111)
I20260808 14:44:15.783209 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 27602
I20260808 14:44:15.789793 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 27105
2026-08-08T14:44:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (658 ms)
[----------] 6 tests from EncryptionPolicyTest (8769 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:15 dist-test-slave-mjjr krb5kdc[27839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:15 dist-test-slave-mjjr krb5kdc[27839](info): set up 2 sockets
Aug 08 14:44:15 dist-test-slave-mjjr krb5kdc[27839](info): commencing operation
krb5kdc: starting...
W20260808 14:44:16.995908 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:17 dist-test-slave-mjjr krb5kdc[27839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:17.106460 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34673
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:17.185132 27856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:17.185355 27856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:17.185393 27856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:17.186497 27856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:17.186580 27856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:17.186605 27856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:17.186627 27856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:17.186655 27856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:17.188091 27856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34673
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:17.188344 27856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:17.188541 27856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:17.193200 27869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:17.193197 27866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:17.193233 27867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:17.193387 27856 server_base.cc:1034] running on GCE node
I20260808 14:44:17.193600 27856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:17.193874 27856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:17.195019 27856 hybrid_clock.cc:648] HybridClock initialized: now 1786200257195006 us; error 29 us; skew 500 ppm
Aug 08 14:44:17 dist-test-slave-mjjr krb5kdc[27839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200257, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:17.197345 27856 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:17.197737 27856 webserver.cc:460] Webserver started at http://127.0.0.1:44505/ using document root <none> and password file <none>
I20260808 14:44:17.197973 27856 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:17.198035 27856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:17.198184 27856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:17.199136 27856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "90b3ab64230e4910b4cc126d2e77e210"
format_stamp: "Formatted at 2026-08-08 14:44:17 on dist-test-slave-mjjr"
server_key: "8bbe80f2c093420351e92d1200e5e5e5"
server_key_iv: "3a341c4002fd852e551fd835092e7904"
server_key_version: "encryptionkey@0"
I20260808 14:44:17.199476 27856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "90b3ab64230e4910b4cc126d2e77e210"
format_stamp: "Formatted at 2026-08-08 14:44:17 on dist-test-slave-mjjr"
server_key: "8bbe80f2c093420351e92d1200e5e5e5"
server_key_iv: "3a341c4002fd852e551fd835092e7904"
server_key_version: "encryptionkey@0"
I20260808 14:44:17.200846 27856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:17.201499 27880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:17.201655 27856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:17.201752 27856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "90b3ab64230e4910b4cc126d2e77e210"
format_stamp: "Formatted at 2026-08-08 14:44:17 on dist-test-slave-mjjr"
server_key: "8bbe80f2c093420351e92d1200e5e5e5"
server_key_iv: "3a341c4002fd852e551fd835092e7904"
server_key_version: "encryptionkey@0"
I20260808 14:44:17.201825 27856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:17.216884 27856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:17.218403 27856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:17.218575 27856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:17.222426 27856 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34673
I20260808 14:44:17.222499 27953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34673 every 8 connection(s)
I20260808 14:44:17.222826 27856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:17.223717 27954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:17.225725 27954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210: Bootstrap starting.
I20260808 14:44:17.226210 27954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:17.226454 27954 log.cc:824] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:17.227108 27954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210: No bootstrap required, opened a new log
I20260808 14:44:17.228673 27954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90b3ab64230e4910b4cc126d2e77e210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260808 14:44:17.228802 27954 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:17.228825 27954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b3ab64230e4910b4cc126d2e77e210, State: Initialized, Role: FOLLOWER
I20260808 14:44:17.228950 27954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90b3ab64230e4910b4cc126d2e77e210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260808 14:44:17.229030 27954 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:17.229051 27954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:17.229076 27954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:17.229522 27954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90b3ab64230e4910b4cc126d2e77e210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260808 14:44:17.229601 27954 leader_election.cc:302] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90b3ab64230e4910b4cc126d2e77e210; no voters:
I20260808 14:44:17.229717 27954 leader_election.cc:288] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:17.229772 27957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:17.229925 27957 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [term 1 LEADER]: Becoming Leader. State: Replica: 90b3ab64230e4910b4cc126d2e77e210, State: Running, Role: LEADER
I20260808 14:44:17.229950 27954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:17.230012 27957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90b3ab64230e4910b4cc126d2e77e210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260808 14:44:17.230381 27960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90b3ab64230e4910b4cc126d2e77e210. Latest consensus state: current_term: 1 leader_uuid: "90b3ab64230e4910b4cc126d2e77e210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90b3ab64230e4910b4cc126d2e77e210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } } }
I20260808 14:44:17.230463 27960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:17.230520 27959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90b3ab64230e4910b4cc126d2e77e210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90b3ab64230e4910b4cc126d2e77e210" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } } }
I20260808 14:44:17.230615 27959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:17.230674 27966 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:17.230741 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 27856
I20260808 14:44:17.230841 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:17.231050 30371 external_mini_cluster.cc:1428] Setting key a194aad8eab968297bc307382acfcfcf
I20260808 14:44:17.231132 27966 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:17.232615 27966 catalog_manager.cc:1347] Generated new cluster ID: 5d8e01ed3e204bed934b0d43c90fe2f1
I20260808 14:44:17.232667 27966 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:17 dist-test-slave-mjjr krb5kdc[27839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:44:17.242691 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:17.231600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32877 (local address 127.0.0.1:34673)
0808 14:44:17.232530 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:17.232538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:17.232569 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:44:17.232721 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:17.232728 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:17.232780 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:17.232920 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:17.233623 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:17.234980 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:17.235965 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:17.236554 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:17.236662 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:17.239466 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:17.239469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:17.239470 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:17.239480 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:17.241113 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:17.241513 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:17.241515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:17.241516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:17.241602 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:17.241831 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:17.241831 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:17.241831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:17.242100 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:17.242262 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:17.242389 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:44:17.242480 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":76,"threads_started":1}
I20260808 14:44:17.243777 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:17.250715 27966 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:17.251307 27966 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:17.251892 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:17.245157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34791 (local address 127.0.0.1:34673)
0808 14:44:17.245188 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:17.245189 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:17.245350 (+ 161us) server_negotiation.cc:407] Connection header received
0808 14:44:17.245393 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:17.245394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:17.245414 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:17.245458 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:17.246027 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:17.246718 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:17.247750 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:17.248021 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:17.248076 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:17.249303 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:17.249305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:17.249305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:17.249311 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:17.250792 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:17.251126 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:17.251127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:17.251127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:17.251172 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:17.251423 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:17.251424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:17.251424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:17.251518 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:17.251606 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:17.251752 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 14:44:17.251805 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:17.258901 27966 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90b3ab64230e4910b4cc126d2e77e210: Generated new TSK 0
I20260808 14:44:17.259047 27966 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:17.265695 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 27856
W20260808 14:44:17.278085 27837 connection.cc:535] client connection to 127.0.0.1:34673 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34673): Connection reset by peer (error 104)
2026-08-08T14:44:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:17 dist-test-slave-mjjr krb5kdc[27989](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:17 dist-test-slave-mjjr krb5kdc[27989](info): set up 2 sockets
Aug 08 14:44:17 dist-test-slave-mjjr krb5kdc[27989](info): commencing operation
krb5kdc: starting...
W20260808 14:44:18.460440 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:18 dist-test-slave-mjjr krb5kdc[27989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:18.570039 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43397
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:18.648306 28006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:18.648490 28006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:18.648511 28006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:18.649461 28006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:18.649510 28006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:18.649537 28006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:18.649549 28006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:18.649559 28006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:18.650902 28006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43397
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:18.651072 28006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:18.651230 28006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:18.655761 28016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:18.655800 28020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:18.655797 28014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:18.655965 28006 server_base.cc:1034] running on GCE node
I20260808 14:44:18.656175 28006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:18.656404 28006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:18.657536 28006 hybrid_clock.cc:648] HybridClock initialized: now 1786200258657526 us; error 30 us; skew 500 ppm
Aug 08 14:44:18 dist-test-slave-mjjr krb5kdc[27989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200258, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:18.660003 28006 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:18.660405 28006 webserver.cc:460] Webserver started at http://127.0.0.1:34313/ using document root <none> and password file <none>
I20260808 14:44:18.660634 28006 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:18.660677 28006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:18.660807 28006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:18.661742 28006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "1ab381c24746454298c81f4a4a7a3617"
format_stamp: "Formatted at 2026-08-08 14:44:18 on dist-test-slave-mjjr"
server_key: "efc9c854bf76e0e63f5a53fa7d9f85e5"
server_key_iv: "51b907005e3b85191226f08f7ac0eeba"
server_key_version: "encryptionkey@0"
I20260808 14:44:18.662067 28006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "1ab381c24746454298c81f4a4a7a3617"
format_stamp: "Formatted at 2026-08-08 14:44:18 on dist-test-slave-mjjr"
server_key: "efc9c854bf76e0e63f5a53fa7d9f85e5"
server_key_iv: "51b907005e3b85191226f08f7ac0eeba"
server_key_version: "encryptionkey@0"
I20260808 14:44:18.663403 28006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:44:18.664141 28028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:18.664315 28006 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:18.664395 28006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "1ab381c24746454298c81f4a4a7a3617"
format_stamp: "Formatted at 2026-08-08 14:44:18 on dist-test-slave-mjjr"
server_key: "efc9c854bf76e0e63f5a53fa7d9f85e5"
server_key_iv: "51b907005e3b85191226f08f7ac0eeba"
server_key_version: "encryptionkey@0"
I20260808 14:44:18.664460 28006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:18.676110 28006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:18.677709 28006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:18.677857 28006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:18.681631 28006 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43397
I20260808 14:44:18.681706 28097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43397 every 8 connection(s)
I20260808 14:44:18.682000 28006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:18.682870 28098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:18.684221 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28006
I20260808 14:44:18.684338 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:18.684566 30371 external_mini_cluster.cc:1428] Setting key c5e3e27e955ccacc157079d057b5afcf
I20260808 14:44:18.685606 28098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617: Bootstrap starting.
I20260808 14:44:18.686285 28098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:18.686615 28098 log.cc:824] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:18.687376 28098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617: No bootstrap required, opened a new log
I20260808 14:44:18.689548 28098 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab381c24746454298c81f4a4a7a3617" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43397 } }
I20260808 14:44:18.689711 28098 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:18.689812 28098 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab381c24746454298c81f4a4a7a3617, State: Initialized, Role: FOLLOWER
I20260808 14:44:18.689996 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:18.685043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59295 (local address 127.0.0.1:43397)
0808 14:44:18.685210 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:18.685217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:18.685240 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:44:18.685660 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:18.685665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:18.685727 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:18.685846 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:18.686091 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:18.687180 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:18.688260 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:18.688627 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:18.688696 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:18.689362 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:18.689365 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:18.689365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:18.689527 (+ 162us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:18.689552 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:18.689561 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:18.689620 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:18.689771 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:44:18.689800 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260808 14:44:18.690002 28098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab381c24746454298c81f4a4a7a3617" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43397 } }
I20260808 14:44:18.690142 28098 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:18.690176 28098 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:18.690217 28098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:18.690814 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:18.690853 28098 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab381c24746454298c81f4a4a7a3617" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43397 } }
I20260808 14:44:18.690977 28098 leader_election.cc:302] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ab381c24746454298c81f4a4a7a3617; no voters:
I20260808 14:44:18.691141 28098 leader_election.cc:288] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:18.691171 28105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:18.691282 28105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [term 1 LEADER]: Becoming Leader. State: Replica: 1ab381c24746454298c81f4a4a7a3617, State: Running, Role: LEADER
I20260808 14:44:18.691417 28098 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:18.691403 28105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab381c24746454298c81f4a4a7a3617" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43397 } }
I20260808 14:44:18.691771 28105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ab381c24746454298c81f4a4a7a3617. Latest consensus state: current_term: 1 leader_uuid: "1ab381c24746454298c81f4a4a7a3617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab381c24746454298c81f4a4a7a3617" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43397 } } }
I20260808 14:44:18.691782 28108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ab381c24746454298c81f4a4a7a3617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab381c24746454298c81f4a4a7a3617" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43397 } } }
I20260808 14:44:18.691989 28105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:18.692003 28108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:18.692639 28126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:18.693183 28126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:18.694756 28126 catalog_manager.cc:1347] Generated new cluster ID: c621add5cd934a15bdc494052a70b815
I20260808 14:44:18.694803 28126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:18.695919 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:18.692322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41701 (local address 127.0.0.1:43397)
0808 14:44:18.692359 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:18.692361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:18.692520 (+ 159us) server_negotiation.cc:407] Connection header received
0808 14:44:18.692618 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:18.692618 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:18.692628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:18.692659 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:18.692977 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:18.693637 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:18.694630 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:18.694908 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:18.694982 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:18.695635 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:18.695636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:18.695637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:18.695642 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:18.695680 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:18.695684 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:18.695715 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:18.695850 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:44:18.695860 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:18.705054 28126 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:18.705688 28126 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:18.714123 28126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ab381c24746454298c81f4a4a7a3617: Generated new TSK 0
I20260808 14:44:18.714294 28126 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:18.716990 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28006
W20260808 14:44:18.729504 27987 connection.cc:535] client connection to 127.0.0.1:43397 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43397): Connection reset by peer (error 104)
2026-08-08T14:44:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:18 dist-test-slave-mjjr krb5kdc[28141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:18 dist-test-slave-mjjr krb5kdc[28141](info): set up 2 sockets
Aug 08 14:44:18 dist-test-slave-mjjr krb5kdc[28141](info): commencing operation
krb5kdc: starting...
W20260808 14:44:19.906307 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:19 dist-test-slave-mjjr krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:20.016366 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45831
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:20.094292 28157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:20.094530 28157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:20.094581 28157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:20.095742 28157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:20.095808 28157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:20.095831 28157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:20.095852 28157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:20.095880 28157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:20.097280 28157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45831
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:20.097546 28157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:20.097793 28157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:20.102630 28166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:20.102785 28157 server_base.cc:1034] running on GCE node
W20260808 14:44:20.102666 28164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:20.102644 28163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:20.103089 28157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:20.103366 28157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:20.104504 28157 hybrid_clock.cc:648] HybridClock initialized: now 1786200260104479 us; error 45 us; skew 500 ppm
Aug 08 14:44:20 dist-test-slave-mjjr krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200260, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:20.106859 28157 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:20.107316 28157 webserver.cc:460] Webserver started at http://127.0.0.1:44983/ using document root <none> and password file <none>
I20260808 14:44:20.107537 28157 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:20.107605 28157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:20.107786 28157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:20.108754 28157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "376b6477312f40289db49de201bfc458"
format_stamp: "Formatted at 2026-08-08 14:44:20 on dist-test-slave-mjjr"
server_key: "22e5fcd6dea7d17d949df472194e3cdf"
server_key_iv: "56ee4ecfc9dd11a4c89672fc594754bf"
server_key_version: "encryptionkey@0"
I20260808 14:44:20.109113 28157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "376b6477312f40289db49de201bfc458"
format_stamp: "Formatted at 2026-08-08 14:44:20 on dist-test-slave-mjjr"
server_key: "22e5fcd6dea7d17d949df472194e3cdf"
server_key_iv: "56ee4ecfc9dd11a4c89672fc594754bf"
server_key_version: "encryptionkey@0"
I20260808 14:44:20.110407 28157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:44:20.111136 28173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:20.111334 28157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:20.111433 28157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "376b6477312f40289db49de201bfc458"
format_stamp: "Formatted at 2026-08-08 14:44:20 on dist-test-slave-mjjr"
server_key: "22e5fcd6dea7d17d949df472194e3cdf"
server_key_iv: "56ee4ecfc9dd11a4c89672fc594754bf"
server_key_version: "encryptionkey@0"
I20260808 14:44:20.111517 28157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:20.114676 28157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:20.116444 28157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:20.116592 28157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:20.120644 28157 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45831
I20260808 14:44:20.120673 28253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45831 every 8 connection(s)
I20260808 14:44:20.120973 28157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:20.121905 28255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:20.124135 28255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458: Bootstrap starting.
I20260808 14:44:20.124715 28255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:20.125034 28255 log.cc:824] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:20.125679 28255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458: No bootstrap required, opened a new log
I20260808 14:44:20.127233 28255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376b6477312f40289db49de201bfc458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45831 } }
I20260808 14:44:20.127372 28255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:20.127395 28255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376b6477312f40289db49de201bfc458, State: Initialized, Role: FOLLOWER
I20260808 14:44:20.127579 28255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376b6477312f40289db49de201bfc458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45831 } }
I20260808 14:44:20.127688 28255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:20.127734 28255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:20.127784 28255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:20.128262 28255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376b6477312f40289db49de201bfc458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45831 } }
I20260808 14:44:20.128373 28255 leader_election.cc:302] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 376b6477312f40289db49de201bfc458; no voters:
I20260808 14:44:20.128548 28255 leader_election.cc:288] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:20.128588 28258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:20.128785 28255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:20.128927 28258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [term 1 LEADER]: Becoming Leader. State: Replica: 376b6477312f40289db49de201bfc458, State: Running, Role: LEADER
I20260808 14:44:20.129081 28258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376b6477312f40289db49de201bfc458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45831 } }
I20260808 14:44:20.129500 28260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 376b6477312f40289db49de201bfc458. Latest consensus state: current_term: 1 leader_uuid: "376b6477312f40289db49de201bfc458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376b6477312f40289db49de201bfc458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45831 } } }
I20260808 14:44:20.129587 28260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:20.129848 28268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:20.129935 28259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "376b6477312f40289db49de201bfc458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376b6477312f40289db49de201bfc458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45831 } } }
I20260808 14:44:20.129997 28259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:20.130407 28268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:20.130453 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28157
I20260808 14:44:20.130573 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:20.130784 30371 external_mini_cluster.cc:1428] Setting key 08cfd6fcf48dfb57beb7de58336416f5
I20260808 14:44:20.132113 28268 catalog_manager.cc:1347] Generated new cluster ID: a8175523705d4b949ea6e88a76655801
I20260808 14:44:20.132167 28268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:20.133880 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:20.131209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49869 (local address 127.0.0.1:45831)
0808 14:44:20.131970 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:20.131978 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:20.132010 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:44:20.132117 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:20.132124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:20.132154 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:20.132293 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:20.133301 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:20.133305 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:20.133305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:20.133310 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:20.133353 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:20.133367 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:20.133451 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:20.133646 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 14:44:20.133691 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":71,"threads_started":1}
I20260808 14:44:20.135042 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:20.137699 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:20.136728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57947 (local address 127.0.0.1:45831)
0808 14:44:20.136761 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:20.136763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:20.136840 (+ 77us) server_negotiation.cc:407] Connection header received
0808 14:44:20.136887 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:20.136888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:20.136892 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:20.136962 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:20.137495 (+ 533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:20.137496 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:20.137496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:20.137501 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:20.137515 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:20.137520 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:20.137575 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:20.137626 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:44:20.137640 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:44:20.142784 28268 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:20.142949 28268 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:20.150168 28268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 376b6477312f40289db49de201bfc458: Generated new TSK 0
I20260808 14:44:20.150327 28268 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:20.156302 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28157
2026-08-08T14:44:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:20 dist-test-slave-mjjr krb5kdc[28297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:20 dist-test-slave-mjjr krb5kdc[28297](info): set up 2 sockets
Aug 08 14:44:20 dist-test-slave-mjjr krb5kdc[28297](info): commencing operation
krb5kdc: starting...
W20260808 14:44:21.344471 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:21 dist-test-slave-mjjr krb5kdc[28297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:21.456135 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:21.534569 28317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:21.534754 28317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:21.534776 28317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:21.535905 28317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:21.535943 28317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:21.535957 28317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:21.535969 28317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:21.536019 28317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:21.537451 28317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:21.537706 28317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:21.537922 28317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:21.542212 28323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:21.542218 28325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:21.542280 28317 server_base.cc:1034] running on GCE node
W20260808 14:44:21.542234 28322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:21.542603 28317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:21.542882 28317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:21.544023 28317 hybrid_clock.cc:648] HybridClock initialized: now 1786200261544010 us; error 29 us; skew 500 ppm
Aug 08 14:44:21 dist-test-slave-mjjr krb5kdc[28297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200261, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:21.546371 28317 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:21.546784 28317 webserver.cc:460] Webserver started at http://127.0.0.1:35411/ using document root <none> and password file <none>
I20260808 14:44:21.547008 28317 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:21.547050 28317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:21.547214 28317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:21.548264 28317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "31ba2c9f25024490b23c409c6fe2655e"
format_stamp: "Formatted at 2026-08-08 14:44:21 on dist-test-slave-mjjr"
server_key: "516afcbfd10f4c7c2049871b70e14dc6"
server_key_iv: "c141e4ecf2243fd860a7f71b80f1a0bd"
server_key_version: "encryptionkey@0"
I20260808 14:44:21.548625 28317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "31ba2c9f25024490b23c409c6fe2655e"
format_stamp: "Formatted at 2026-08-08 14:44:21 on dist-test-slave-mjjr"
server_key: "516afcbfd10f4c7c2049871b70e14dc6"
server_key_iv: "c141e4ecf2243fd860a7f71b80f1a0bd"
server_key_version: "encryptionkey@0"
I20260808 14:44:21.549973 28317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:21.550787 28332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:21.550981 28317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:21.551069 28317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "31ba2c9f25024490b23c409c6fe2655e"
format_stamp: "Formatted at 2026-08-08 14:44:21 on dist-test-slave-mjjr"
server_key: "516afcbfd10f4c7c2049871b70e14dc6"
server_key_iv: "c141e4ecf2243fd860a7f71b80f1a0bd"
server_key_version: "encryptionkey@0"
I20260808 14:44:21.551139 28317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:21.560285 28317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:21.561820 28317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:21.561952 28317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:21.565919 28317 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46487
I20260808 14:44:21.565975 28400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46487 every 8 connection(s)
I20260808 14:44:21.566273 28317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:21.567081 28402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:21.569242 28402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e: Bootstrap starting.
I20260808 14:44:21.569800 28402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:21.570093 28402 log.cc:824] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:21.570348 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28317
I20260808 14:44:21.570477 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:21.570698 30371 external_mini_cluster.cc:1428] Setting key 7b40d695fb2566560a63ad315acb67ec
I20260808 14:44:21.570887 28402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e: No bootstrap required, opened a new log
I20260808 14:44:21.573149 28402 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ba2c9f25024490b23c409c6fe2655e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:44:21.573269 28402 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:21.573290 28402 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ba2c9f25024490b23c409c6fe2655e, State: Initialized, Role: FOLLOWER
I20260808 14:44:21.573423 28402 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ba2c9f25024490b23c409c6fe2655e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:44:21.573484 28402 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:21.573505 28402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:21.573571 28402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:21.574180 28402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ba2c9f25024490b23c409c6fe2655e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:44:21.574259 28402 leader_election.cc:302] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31ba2c9f25024490b23c409c6fe2655e; no voters:
I20260808 14:44:21.574466 28402 leader_election.cc:288] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:21.574491 28408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:21.574610 28408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [term 1 LEADER]: Becoming Leader. State: Replica: 31ba2c9f25024490b23c409c6fe2655e, State: Running, Role: LEADER
I20260808 14:44:21.574743 28402 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:21.574759 28408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ba2c9f25024490b23c409c6fe2655e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:44:21.575053 28408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31ba2c9f25024490b23c409c6fe2655e. Latest consensus state: current_term: 1 leader_uuid: "31ba2c9f25024490b23c409c6fe2655e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ba2c9f25024490b23c409c6fe2655e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } } }
I20260808 14:44:21.575148 28408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:21.575069 28409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31ba2c9f25024490b23c409c6fe2655e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ba2c9f25024490b23c409c6fe2655e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } } }
I20260808 14:44:21.575371 28409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:21.576242 28416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 14:44:21 dist-test-slave-mjjr krb5kdc[28297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:44:21.577939 28416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:21.579486 28416 catalog_manager.cc:1347] Generated new cluster ID: e084c82408f54508a8c4014a3574cbd4
I20260808 14:44:21.579540 28416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:21.581758 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:21.571140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59311 (local address 127.0.0.1:46487)
0808 14:44:21.571282 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:21.571288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:21.571318 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:44:21.572117 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:21.572124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:21.572168 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:21.572272 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:21.573064 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:21.574341 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:21.575338 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:21.576034 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:21.576167 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:21.578429 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:21.578433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:21.578433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:21.578445 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:21.580286 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:21.580665 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:21.580668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:21.580668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:21.580752 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:21.580970 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:21.580971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:21.580971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:21.581192 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:21.581339 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:21.581451 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 14:44:21.581581 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260808 14:44:21.584568 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:21.593600 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:21.585859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44251 (local address 127.0.0.1:46487)
0808 14:44:21.585902 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:21.585904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:21.587840 (+ 1936us) server_negotiation.cc:407] Connection header received
0808 14:44:21.587917 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:21.587917 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:21.587927 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:21.587980 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:21.588500 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:21.588950 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:21.589595 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:21.589809 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:21.589883 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:21.591024 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:21.591025 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:21.591026 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:21.591032 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:21.592473 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:21.592836 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:21.592838 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:21.592838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:21.592891 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:21.593098 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:21.593099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:21.593100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:21.593207 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:21.593301 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:21.593418 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:44:21.593489 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:44:21.593623 28416 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:21.594368 28416 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:21.602320 28416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31ba2c9f25024490b23c409c6fe2655e: Generated new TSK 0
I20260808 14:44:21.602465 28416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:21.610059 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28317
2026-08-08T14:44:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:21 dist-test-slave-mjjr krb5kdc[28442](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:21 dist-test-slave-mjjr krb5kdc[28442](info): set up 2 sockets
Aug 08 14:44:21 dist-test-slave-mjjr krb5kdc[28442](info): commencing operation
krb5kdc: starting...
W20260808 14:44:22.798038 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:22 dist-test-slave-mjjr krb5kdc[28442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:22.916424 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39451
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:22.998040 28466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:22.998256 28466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:22.998293 28466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:22.999389 28466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:22.999455 28466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:22.999481 28466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:22.999511 28466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:22.999536 28466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:23.001199 28466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:23.001473 28466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:23.001690 28466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:23.006412 28474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:23.006526 28472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:23.006420 28477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:23.006659 28466 server_base.cc:1034] running on GCE node
I20260808 14:44:23.006893 28466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:23.007174 28466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:23.008333 28466 hybrid_clock.cc:648] HybridClock initialized: now 1786200263008327 us; error 50 us; skew 500 ppm
Aug 08 14:44:23 dist-test-slave-mjjr krb5kdc[28442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200263, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:23.016357 28466 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:23.016772 28466 webserver.cc:460] Webserver started at http://127.0.0.1:34231/ using document root <none> and password file <none>
I20260808 14:44:23.016995 28466 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:23.017062 28466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:23.017218 28466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:23.018257 28466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "06010881b2c04285a88b48c11f0fa057"
format_stamp: "Formatted at 2026-08-08 14:44:23 on dist-test-slave-mjjr"
server_key: "5647889b793452f544320a7569ff3c32"
server_key_iv: "921f793eed9376e15c2d1bae6e482eb5"
server_key_version: "encryptionkey@0"
I20260808 14:44:23.018623 28466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "06010881b2c04285a88b48c11f0fa057"
format_stamp: "Formatted at 2026-08-08 14:44:23 on dist-test-slave-mjjr"
server_key: "5647889b793452f544320a7569ff3c32"
server_key_iv: "921f793eed9376e15c2d1bae6e482eb5"
server_key_version: "encryptionkey@0"
I20260808 14:44:23.020041 28466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:23.020833 28488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:23.021003 28466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:23.021106 28466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "06010881b2c04285a88b48c11f0fa057"
format_stamp: "Formatted at 2026-08-08 14:44:23 on dist-test-slave-mjjr"
server_key: "5647889b793452f544320a7569ff3c32"
server_key_iv: "921f793eed9376e15c2d1bae6e482eb5"
server_key_version: "encryptionkey@0"
I20260808 14:44:23.021175 28466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:23.033043 28466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:23.034677 28466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:23.034833 28466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:23.038880 28466 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39451
I20260808 14:44:23.038908 28559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39451 every 8 connection(s)
I20260808 14:44:23.039237 28466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:23.040112 28560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:23.041033 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28466
I20260808 14:44:23.041177 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:23.041394 30371 external_mini_cluster.cc:1428] Setting key 7c6da2b1531e78df6e18205f43d51618
I20260808 14:44:23.042788 28560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057: Bootstrap starting.
I20260808 14:44:23.043421 28560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:23.043766 28560 log.cc:824] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:23.044503 28560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057: No bootstrap required, opened a new log
I20260808 14:44:23.046756 28560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06010881b2c04285a88b48c11f0fa057" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39451 } }
I20260808 14:44:23.046923 28560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:23.046962 28560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06010881b2c04285a88b48c11f0fa057, State: Initialized, Role: FOLLOWER
I20260808 14:44:23.046993 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:23.041896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52865 (local address 127.0.0.1:39451)
0808 14:44:23.042071 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:23.042078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:23.042101 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:44:23.042582 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:23.042588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:23.042630 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:23.042737 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:23.042998 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:23.044095 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:23.044959 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:23.045557 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:23.045669 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:23.046281 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:23.046285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:23.046285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:23.046541 (+ 256us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:23.046577 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:23.046591 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:23.046661 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:23.046738 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:44:23.046801 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260808 14:44:23.047084 28560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06010881b2c04285a88b48c11f0fa057" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39451 } }
I20260808 14:44:23.047168 28560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:23.047206 28560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:23.047258 28560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:23.047915 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:23.048063 28560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06010881b2c04285a88b48c11f0fa057" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39451 } }
I20260808 14:44:23.048179 28560 leader_election.cc:302] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06010881b2c04285a88b48c11f0fa057; no voters:
I20260808 14:44:23.048344 28560 leader_election.cc:288] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:23.048395 28567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:23.048560 28567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [term 1 LEADER]: Becoming Leader. State: Replica: 06010881b2c04285a88b48c11f0fa057, State: Running, Role: LEADER
I20260808 14:44:23.048591 28560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:23.048647 28567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06010881b2c04285a88b48c11f0fa057" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39451 } }
I20260808 14:44:23.048971 28567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06010881b2c04285a88b48c11f0fa057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06010881b2c04285a88b48c11f0fa057" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39451 } } }
I20260808 14:44:23.049120 28567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:23.049319 28567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06010881b2c04285a88b48c11f0fa057. Latest consensus state: current_term: 1 leader_uuid: "06010881b2c04285a88b48c11f0fa057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06010881b2c04285a88b48c11f0fa057" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39451 } } }
I20260808 14:44:23.049443 28567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:23.049796 28583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:23.050446 28583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:23.051923 28583 catalog_manager.cc:1347] Generated new cluster ID: f1e01dd6a0724cdb9ca0019d58d5f524
I20260808 14:44:23.051980 28583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:23.052870 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:23.049481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42707 (local address 127.0.0.1:39451)
0808 14:44:23.049513 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:23.049515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:23.049743 (+ 228us) server_negotiation.cc:407] Connection header received
0808 14:44:23.049888 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:23.049889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:23.049901 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:23.049962 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:23.050093 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:23.050588 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:23.051490 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:23.051790 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:23.051874 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:23.052631 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:23.052632 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:23.052633 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:23.052637 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:23.052650 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:23.052654 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:23.052697 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:23.052762 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:44:23.052783 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:44:23.065675 28583 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:23.066170 28583 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:23.080571 28583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06010881b2c04285a88b48c11f0fa057: Generated new TSK 0
I20260808 14:44:23.080766 28583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:23.086315 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28466
2026-08-08T14:44:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1476 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:23 dist-test-slave-mjjr krb5kdc[28601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:23 dist-test-slave-mjjr krb5kdc[28601](info): set up 2 sockets
Aug 08 14:44:23 dist-test-slave-mjjr krb5kdc[28601](info): commencing operation
krb5kdc: starting...
W20260808 14:44:24.276017 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:24 dist-test-slave-mjjr krb5kdc[28601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:24.386452 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42999
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:24.466411 28619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:24.466624 28619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:24.466646 28619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:24.467737 28619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:24.467769 28619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:24.467782 28619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:24.467792 28619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:24.467803 28619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:24.469131 28619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:24.469310 28619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:24.469468 28619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:24.474028 28628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:24.474036 28631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:24.474252 28619 server_base.cc:1034] running on GCE node
W20260808 14:44:24.474061 28629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:24.474574 28619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:24.474865 28619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:24.476027 28619 hybrid_clock.cc:648] HybridClock initialized: now 1786200264476021 us; error 36 us; skew 500 ppm
Aug 08 14:44:24 dist-test-slave-mjjr krb5kdc[28601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200264, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:24.478421 28619 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:24.478847 28619 webserver.cc:460] Webserver started at http://127.0.0.1:37095/ using document root <none> and password file <none>
I20260808 14:44:24.479065 28619 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:24.479125 28619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:24.479259 28619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:24.480230 28619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "5e51d1063a2e40589baf51027813355f"
format_stamp: "Formatted at 2026-08-08 14:44:24 on dist-test-slave-mjjr"
server_key: "6dce1d8b157515f2405cff104f683d87"
server_key_iv: "2d0413efd28e7ecc37da259cf5bc77cb"
server_key_version: "encryptionkey@0"
I20260808 14:44:24.480561 28619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "5e51d1063a2e40589baf51027813355f"
format_stamp: "Formatted at 2026-08-08 14:44:24 on dist-test-slave-mjjr"
server_key: "6dce1d8b157515f2405cff104f683d87"
server_key_iv: "2d0413efd28e7ecc37da259cf5bc77cb"
server_key_version: "encryptionkey@0"
I20260808 14:44:24.481781 28619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:24.482462 28639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:24.482651 28619 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:24.482771 28619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "5e51d1063a2e40589baf51027813355f"
format_stamp: "Formatted at 2026-08-08 14:44:24 on dist-test-slave-mjjr"
server_key: "6dce1d8b157515f2405cff104f683d87"
server_key_iv: "2d0413efd28e7ecc37da259cf5bc77cb"
server_key_version: "encryptionkey@0"
I20260808 14:44:24.482841 28619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:24.485988 28619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:24.488206 28619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:24.488358 28619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:24.492487 28619 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42999
I20260808 14:44:24.492528 28722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42999 every 8 connection(s)
I20260808 14:44:24.492890 28619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:24.493863 28723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:24.496191 28723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f: Bootstrap starting.
I20260808 14:44:24.496819 28723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:24.497115 28723 log.cc:824] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:24.497808 28723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f: No bootstrap required, opened a new log
I20260808 14:44:24.499328 28723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e51d1063a2e40589baf51027813355f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42999 } }
I20260808 14:44:24.499451 28723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:24.499471 28723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e51d1063a2e40589baf51027813355f, State: Initialized, Role: FOLLOWER
I20260808 14:44:24.499696 28723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e51d1063a2e40589baf51027813355f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42999 } }
I20260808 14:44:24.499771 28723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:24.499809 28723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:24.499857 28723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:24.500368 28723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e51d1063a2e40589baf51027813355f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42999 } }
I20260808 14:44:24.500494 28723 leader_election.cc:302] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e51d1063a2e40589baf51027813355f; no voters:
I20260808 14:44:24.500651 28723 leader_election.cc:288] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:24.500692 28729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:24.500859 28729 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [term 1 LEADER]: Becoming Leader. State: Replica: 5e51d1063a2e40589baf51027813355f, State: Running, Role: LEADER
I20260808 14:44:24.500952 28729 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e51d1063a2e40589baf51027813355f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42999 } }
I20260808 14:44:24.501024 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28619
I20260808 14:44:24.501143 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:24.501281 28730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e51d1063a2e40589baf51027813355f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e51d1063a2e40589baf51027813355f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42999 } } }
I20260808 14:44:24.501333 30371 external_mini_cluster.cc:1428] Setting key 47e437a13f5f3fd86a76d53a654217ad
I20260808 14:44:24.501372 28730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:24.501487 28731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e51d1063a2e40589baf51027813355f. Latest consensus state: current_term: 1 leader_uuid: "5e51d1063a2e40589baf51027813355f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e51d1063a2e40589baf51027813355f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42999 } } }
I20260808 14:44:24.501550 28731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:24.501941 28723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:24.502003 28733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:24.502485 28733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:24.503974 28736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:24.501728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52361 (local address 127.0.0.1:42999)
0808 14:44:24.501879 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:24.501897 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:24.501983 (+ 86us) server_negotiation.cc:407] Connection header received
0808 14:44:24.502142 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:24.502149 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:24.502177 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:24.502316 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:24.502954 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:24.502957 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:24.502957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:24.502961 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:24.503499 (+ 538us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:24.503516 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:24.503593 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:24.503718 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 14:44:24.503762 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":74,"threads_started":1}
I20260808 14:44:24.504628 28733 catalog_manager.cc:1347] Generated new cluster ID: 21745860770d4c5dbb0ea52db21cff7a
I20260808 14:44:24.504683 28733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:24.505087 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:24.508565 28736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:24.506598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53831 (local address 127.0.0.1:42999)
0808 14:44:24.507727 (+ 1129us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:24.507729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:24.507737 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:24.507757 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:24.507758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:24.507763 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:24.507823 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:24.508354 (+ 531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:24.508355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:24.508355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:24.508359 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:24.508372 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:24.508388 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:24.508445 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:24.508490 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:44:24.508501 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1109}
I20260808 14:44:24.522362 28733 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:24.522497 28733 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:24.526502 28733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e51d1063a2e40589baf51027813355f: Generated new TSK 0
I20260808 14:44:24.526661 28733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:24.531630 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28619
2026-08-08T14:44:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:24 dist-test-slave-mjjr krb5kdc[28765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:24 dist-test-slave-mjjr krb5kdc[28765](info): set up 2 sockets
Aug 08 14:44:24 dist-test-slave-mjjr krb5kdc[28765](info): commencing operation
krb5kdc: starting...
W20260808 14:44:25.719183 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:25 dist-test-slave-mjjr krb5kdc[28765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:25.833942 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39843
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:25.914831 28781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:25.915046 28781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:25.915082 28781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:25.916181 28781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:25.916245 28781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:25.916266 28781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:25.916285 28781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:25.916312 28781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:25.917742 28781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:25.918004 28781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:25.918226 28781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:25.922655 28787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:25.922708 28781 server_base.cc:1034] running on GCE node
W20260808 14:44:25.922814 28786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:25.922689 28789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:25.923223 28781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:25.923521 28781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:25.924680 28781 hybrid_clock.cc:648] HybridClock initialized: now 1786200265924657 us; error 38 us; skew 500 ppm
Aug 08 14:44:25 dist-test-slave-mjjr krb5kdc[28765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200265, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:25.927023 28781 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:25.927428 28781 webserver.cc:460] Webserver started at http://127.0.0.1:46145/ using document root <none> and password file <none>
I20260808 14:44:25.927731 28781 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:25.927798 28781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:25.927963 28781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:25.928953 28781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "f08466e1f2b44e8698477ad184796fce"
format_stamp: "Formatted at 2026-08-08 14:44:25 on dist-test-slave-mjjr"
server_key: "db1f6fe7973017454234b95fa379e525"
server_key_iv: "ba77d7ca3785588af330ad22a7255cc1"
server_key_version: "encryptionkey@0"
I20260808 14:44:25.929380 28781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "f08466e1f2b44e8698477ad184796fce"
format_stamp: "Formatted at 2026-08-08 14:44:25 on dist-test-slave-mjjr"
server_key: "db1f6fe7973017454234b95fa379e525"
server_key_iv: "ba77d7ca3785588af330ad22a7255cc1"
server_key_version: "encryptionkey@0"
I20260808 14:44:25.930677 28781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:25.931404 28800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:25.931583 28781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:25.931689 28781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "f08466e1f2b44e8698477ad184796fce"
format_stamp: "Formatted at 2026-08-08 14:44:25 on dist-test-slave-mjjr"
server_key: "db1f6fe7973017454234b95fa379e525"
server_key_iv: "ba77d7ca3785588af330ad22a7255cc1"
server_key_version: "encryptionkey@0"
I20260808 14:44:25.931766 28781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:25.943444 28781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:25.946342 28781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:25.946560 28781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:25.951824 28781 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39843
I20260808 14:44:25.951885 28868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39843 every 8 connection(s)
I20260808 14:44:25.952255 28781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:25.953262 28869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:25.956879 28869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce: Bootstrap starting.
I20260808 14:44:25.957458 28869 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:25.957773 28869 log.cc:824] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:25.958385 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28781
I20260808 14:44:25.958516 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:25.958626 28869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce: No bootstrap required, opened a new log
I20260808 14:44:25.958726 30371 external_mini_cluster.cc:1428] Setting key f13545cdbd1a3d6f681e93758953cf0f
I20260808 14:44:25.961621 28869 raft_consensus.cc:348] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f08466e1f2b44e8698477ad184796fce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39843 } }
I20260808 14:44:25.961788 28869 raft_consensus.cc:374] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:25.961834 28869 raft_consensus.cc:729] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08466e1f2b44e8698477ad184796fce, State: Initialized, Role: FOLLOWER
I20260808 14:44:25.961956 28869 consensus_queue.cc:260] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f08466e1f2b44e8698477ad184796fce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39843 } }
I20260808 14:44:25.962049 28869 raft_consensus.cc:388] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:25.962093 28869 raft_consensus.cc:482] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:25.962141 28869 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:25.962658 28869 raft_consensus.cc:504] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f08466e1f2b44e8698477ad184796fce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39843 } }
I20260808 14:44:25.962770 28869 leader_election.cc:302] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f08466e1f2b44e8698477ad184796fce; no voters:
I20260808 14:44:25.962954 28869 leader_election.cc:288] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:25.962986 28877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:25.963171 28877 raft_consensus.cc:686] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [term 1 LEADER]: Becoming Leader. State: Replica: f08466e1f2b44e8698477ad184796fce, State: Running, Role: LEADER
I20260808 14:44:25.963312 28877 consensus_queue.cc:237] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f08466e1f2b44e8698477ad184796fce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39843 } }
I20260808 14:44:25.963685 28877 sys_catalog.cc:455] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [sys.catalog]: SysCatalogTable state changed. Reason: New leader f08466e1f2b44e8698477ad184796fce. Latest consensus state: current_term: 1 leader_uuid: "f08466e1f2b44e8698477ad184796fce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f08466e1f2b44e8698477ad184796fce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39843 } } }
I20260808 14:44:25.963985 28877 sys_catalog.cc:458] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:25.963922 28882 sys_catalog.cc:455] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f08466e1f2b44e8698477ad184796fce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f08466e1f2b44e8698477ad184796fce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39843 } } }
I20260808 14:44:25.964430 28882 sys_catalog.cc:458] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:25.964650 28884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:25.965173 28884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:25.963210 28869 sys_catalog.cc:564] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:25.967116 28884 catalog_manager.cc:1347] Generated new cluster ID: b235e22052874ae4afdcfdc2bcf8a634
I20260808 14:44:25.967168 28884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:25 dist-test-slave-mjjr krb5kdc[28765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:44:25.973228 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:25.959466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:54809 (local address 127.0.0.1:39843)
0808 14:44:25.959637 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:25.959645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:25.959712 (+ 67us) server_negotiation.cc:407] Connection header received
0808 14:44:25.961569 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:25.961579 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:25.961653 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:25.962535 (+ 882us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:25.962615 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:25.963964 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:25.965053 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:25.965627 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:25.966050 (+ 423us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:25.968843 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:25.968847 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:25.968847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:25.968859 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:25.971045 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:25.971532 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:25.971534 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:25.971535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:25.971630 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:25.971904 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:25.971905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:25.971905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:25.972181 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:25.972778 (+ 597us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:25.972896 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:44:25.973023 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260808 14:44:25.974128 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:25.979272 28884 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:25.980054 28884 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:25.983268 28876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:25.975689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:57923 (local address 127.0.0.1:39843)
0808 14:44:25.975724 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:25.975725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:25.975839 (+ 114us) server_negotiation.cc:407] Connection header received
0808 14:44:25.975931 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:25.975933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:25.975942 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:25.975969 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:25.976649 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:25.977371 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:25.978348 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:25.978693 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:25.978731 (+ 38us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:25.980160 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:25.980162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:25.980162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:25.980168 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:25.981928 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:25.982423 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:25.982424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:25.982424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:25.982474 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:25.982669 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:25.982670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:25.982670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:25.982766 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:25.982838 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:25.983106 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:44:25.983177 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:44:25.987834 28884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f08466e1f2b44e8698477ad184796fce: Generated new TSK 0
I20260808 14:44:25.987989 28884 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:25.990849 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28781
W20260808 14:44:26.004596 28762 connection.cc:535] client connection to 127.0.0.1:39843 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39843): Connection reset by peer (error 104)
2026-08-08T14:44:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:26 dist-test-slave-mjjr krb5kdc[28912](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:26 dist-test-slave-mjjr krb5kdc[28912](info): set up 2 sockets
Aug 08 14:44:26 dist-test-slave-mjjr krb5kdc[28912](info): commencing operation
krb5kdc: starting...
W20260808 14:44:27.191620 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:27 dist-test-slave-mjjr krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:27.302536 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38825
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:27.380419 28926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:27.380615 28926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:27.380649 28926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:27.381796 28926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:27.381884 28926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:27.381925 28926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:27.381953 28926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:27.381984 28926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:27.383460 28926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:27.383747 28926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:27.383980 28926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:27.388620 28933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:27.388705 28934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:27.388644 28936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:27.388912 28926 server_base.cc:1034] running on GCE node
I20260808 14:44:27.389132 28926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:27.389437 28926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:27.390620 28926 hybrid_clock.cc:648] HybridClock initialized: now 1786200267390603 us; error 42 us; skew 500 ppm
Aug 08 14:44:27 dist-test-slave-mjjr krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:27.393142 28926 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:27.393563 28926 webserver.cc:460] Webserver started at http://127.0.0.1:41463/ using document root <none> and password file <none>
I20260808 14:44:27.393806 28926 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:27.393875 28926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:27.394023 28926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:27.395254 28926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "c81ec890c7d14125baea651c024e43d5"
format_stamp: "Formatted at 2026-08-08 14:44:27 on dist-test-slave-mjjr"
server_key: "6128f26a61bd8573dccc8ab589d9ee43"
server_key_iv: "101dc4cb378cc4e1e0534811cec4940e"
server_key_version: "encryptionkey@0"
I20260808 14:44:27.395758 28926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "c81ec890c7d14125baea651c024e43d5"
format_stamp: "Formatted at 2026-08-08 14:44:27 on dist-test-slave-mjjr"
server_key: "6128f26a61bd8573dccc8ab589d9ee43"
server_key_iv: "101dc4cb378cc4e1e0534811cec4940e"
server_key_version: "encryptionkey@0"
I20260808 14:44:27.397137 28926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:27.397840 28948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:27.398010 28926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:27.398092 28926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "c81ec890c7d14125baea651c024e43d5"
format_stamp: "Formatted at 2026-08-08 14:44:27 on dist-test-slave-mjjr"
server_key: "6128f26a61bd8573dccc8ab589d9ee43"
server_key_iv: "101dc4cb378cc4e1e0534811cec4940e"
server_key_version: "encryptionkey@0"
I20260808 14:44:27.398177 28926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:27.426671 28926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:27.428567 28926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:27.428722 28926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:27.432572 28926 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38825
I20260808 14:44:27.432629 29017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38825 every 8 connection(s)
I20260808 14:44:27.432940 28926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:27.433818 29018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:27.436111 29018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5: Bootstrap starting.
I20260808 14:44:27.436686 29018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:27.436993 29018 log.cc:824] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:27.437247 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 28926
I20260808 14:44:27.437381 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:27.437594 30371 external_mini_cluster.cc:1428] Setting key 4b02d8404b97af59f6e6a09fa3f3c469
I20260808 14:44:27.437829 29018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5: No bootstrap required, opened a new log
I20260808 14:44:27.439620 29018 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81ec890c7d14125baea651c024e43d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38825 } }
I20260808 14:44:27.439850 29018 raft_consensus.cc:374] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:27.439894 29018 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81ec890c7d14125baea651c024e43d5, State: Initialized, Role: FOLLOWER
I20260808 14:44:27.440027 29018 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81ec890c7d14125baea651c024e43d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38825 } }
I20260808 14:44:27.440109 29018 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:27.440130 29018 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:27.440194 29018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:27.440719 29018 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81ec890c7d14125baea651c024e43d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38825 } }
I20260808 14:44:27.440807 29018 leader_election.cc:302] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81ec890c7d14125baea651c024e43d5; no voters:
I20260808 14:44:27.440984 29018 leader_election.cc:288] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:27.441010 29023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:27.441109 29023 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [term 1 LEADER]: Becoming Leader. State: Replica: c81ec890c7d14125baea651c024e43d5, State: Running, Role: LEADER
I20260808 14:44:27.441190 29023 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81ec890c7d14125baea651c024e43d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38825 } }
I20260808 14:44:27.441228 29018 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:27.441565 29024 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c81ec890c7d14125baea651c024e43d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81ec890c7d14125baea651c024e43d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38825 } } }
I20260808 14:44:27.441578 29023 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81ec890c7d14125baea651c024e43d5. Latest consensus state: current_term: 1 leader_uuid: "c81ec890c7d14125baea651c024e43d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81ec890c7d14125baea651c024e43d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38825 } } }
I20260808 14:44:27.441735 29024 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:27.441754 29023 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5 [sys.catalog]: This master's current role is: LEADER
W20260808 14:44:27.443078 29044 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:27.443145 29044 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:27.443691 29035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:27.444236 29035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:27.444936 29022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:27.438109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:41573 (local address 127.0.0.1:38825)
0808 14:44:27.438268 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:27.438277 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:27.438311 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:44:27.439593 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:27.439610 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:27.439696 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:27.439813 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:27.440054 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:27.441557 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:27.442713 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:27.443371 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:27.443482 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:27.444230 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:27.444234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:27.444235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:27.444466 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:27.444496 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:27.444507 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:27.444603 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:27.444683 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:44:27.444713 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260808 14:44:27.445881 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:27.447996 29035 catalog_manager.cc:1347] Generated new cluster ID: b7363ab13c034575b5f0e8161de09890
I20260808 14:44:27.448058 29035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:27.451371 29022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:27.447166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:34953 (local address 127.0.0.1:38825)
0808 14:44:27.447199 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:27.447201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:27.448115 (+ 914us) server_negotiation.cc:407] Connection header received
0808 14:44:27.448201 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:27.448202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:27.448214 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:27.448282 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:27.448431 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:27.449137 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:27.450079 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:27.450398 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:27.450476 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:27.451121 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:27.451122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:27.451123 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:27.451127 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:27.451142 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:27.451147 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:27.451211 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:27.451286 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:44:27.451298 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:44:27.458622 29035 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:27.459133 29035 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:27.467125 29035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c81ec890c7d14125baea651c024e43d5: Generated new TSK 0
I20260808 14:44:27.467281 29035 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:27.471827 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 28926
W20260808 14:44:27.483693 28910 connection.cc:535] client connection to 127.0.0.1:38825 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38825): Connection reset by peer (error 104)
2026-08-08T14:44:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:27 dist-test-slave-mjjr krb5kdc[29056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:27 dist-test-slave-mjjr krb5kdc[29056](info): set up 2 sockets
Aug 08 14:44:27 dist-test-slave-mjjr krb5kdc[29056](info): commencing operation
krb5kdc: starting...
W20260808 14:44:28.631187 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:28 dist-test-slave-mjjr krb5kdc[29056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:28.742105 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45305
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:28.824476 29076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:28.824671 29076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:28.824693 29076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:28.825754 29076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:28.825809 29076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:28.825824 29076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:28.825837 29076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:28.825850 29076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:28.827268 29076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:28.827453 29076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:28.827610 29076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:28.832407 29087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:28.832412 29084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:28.832386 29085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:28.832798 29076 server_base.cc:1034] running on GCE node
I20260808 14:44:28.833046 29076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:28.833354 29076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:28.834522 29076 hybrid_clock.cc:648] HybridClock initialized: now 1786200268834506 us; error 46 us; skew 500 ppm
Aug 08 14:44:28 dist-test-slave-mjjr krb5kdc[29056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:28.841285 29076 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:28.841688 29076 webserver.cc:460] Webserver started at http://127.0.0.1:36249/ using document root <none> and password file <none>
I20260808 14:44:28.841903 29076 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:28.841948 29076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:28.842099 29076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:28.843128 29076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "54e70943f2ca40af806ad862f16ae43d"
format_stamp: "Formatted at 2026-08-08 14:44:28 on dist-test-slave-mjjr"
server_key: "99154d5ac7525f852a45eef635b83b77"
server_key_iv: "eb6534124c85a03897192ec966d96315"
server_key_version: "encryptionkey@0"
I20260808 14:44:28.843502 29076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "54e70943f2ca40af806ad862f16ae43d"
format_stamp: "Formatted at 2026-08-08 14:44:28 on dist-test-slave-mjjr"
server_key: "99154d5ac7525f852a45eef635b83b77"
server_key_iv: "eb6534124c85a03897192ec966d96315"
server_key_version: "encryptionkey@0"
I20260808 14:44:28.844940 29076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:28.845700 29098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:28.845871 29076 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:28.845956 29076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "54e70943f2ca40af806ad862f16ae43d"
format_stamp: "Formatted at 2026-08-08 14:44:28 on dist-test-slave-mjjr"
server_key: "99154d5ac7525f852a45eef635b83b77"
server_key_iv: "eb6534124c85a03897192ec966d96315"
server_key_version: "encryptionkey@0"
I20260808 14:44:28.846007 29076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:28.849082 29076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:28.850674 29076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:28.850769 29076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:28.854516 29076 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45305
I20260808 14:44:28.854564 29174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45305 every 8 connection(s)
I20260808 14:44:28.854867 29076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:28.856379 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 29076
I20260808 14:44:28.856508 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:28.856628 29175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:28.856694 30371 external_mini_cluster.cc:1428] Setting key b33f6770ed7875af006fc4dc1f92115d
I20260808 14:44:28.859066 29179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:28.857185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:34787 (local address 127.0.0.1:45305)
0808 14:44:28.857360 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:28.857368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:28.857397 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:44:28.857839 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:28.857845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:28.857868 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:28.858022 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:28.858655 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:28.858658 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:28.858659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:28.858662 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:28.858705 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:28.858715 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:28.858785 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:28.858862 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:44:28.858903 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260808 14:44:28.859495 29175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d: Bootstrap starting.
I20260808 14:44:28.859997 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:28.860246 29175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:28.860538 29175 log.cc:824] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:28.861274 29175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d: No bootstrap required, opened a new log
I20260808 14:44:28.862504 29179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:28.861469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:39505 (local address 127.0.0.1:45305)
0808 14:44:28.861529 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:28.861531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:28.861653 (+ 122us) server_negotiation.cc:407] Connection header received
0808 14:44:28.861744 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:28.861745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:28.861750 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:28.861800 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:28.862319 (+ 519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:28.862320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:28.862320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:28.862324 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:28.862334 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:28.862338 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:28.862381 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:28.862432 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:44:28.862445 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:44:28.863494 29175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e70943f2ca40af806ad862f16ae43d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45305 } }
I20260808 14:44:28.863615 29175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:28.863682 29175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e70943f2ca40af806ad862f16ae43d, State: Initialized, Role: FOLLOWER
I20260808 14:44:28.863813 29175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e70943f2ca40af806ad862f16ae43d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45305 } }
I20260808 14:44:28.863900 29175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:28.863924 29175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:28.863950 29175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:28.864655 29175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e70943f2ca40af806ad862f16ae43d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45305 } }
I20260808 14:44:28.864738 29175 leader_election.cc:302] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54e70943f2ca40af806ad862f16ae43d; no voters:
I20260808 14:44:28.864848 29175 leader_election.cc:288] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:28.864918 29190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:28.865085 29175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:28.865092 29190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [term 1 LEADER]: Becoming Leader. State: Replica: 54e70943f2ca40af806ad862f16ae43d, State: Running, Role: LEADER
I20260808 14:44:28.865199 29190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e70943f2ca40af806ad862f16ae43d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45305 } }
I20260808 14:44:28.865567 29192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54e70943f2ca40af806ad862f16ae43d. Latest consensus state: current_term: 1 leader_uuid: "54e70943f2ca40af806ad862f16ae43d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e70943f2ca40af806ad862f16ae43d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45305 } } }
I20260808 14:44:28.865710 29192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:28.865871 29191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54e70943f2ca40af806ad862f16ae43d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e70943f2ca40af806ad862f16ae43d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45305 } } }
I20260808 14:44:28.865947 29191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:28.866068 29201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:28.866618 29201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:28.868112 29201 catalog_manager.cc:1347] Generated new cluster ID: 8135ddc61ce442c4828db14bda467ca0
I20260808 14:44:28.868155 29201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:28.875694 29201 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:28.875873 29201 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:28.878908 29201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54e70943f2ca40af806ad862f16ae43d: Generated new TSK 0
I20260808 14:44:28.879071 29201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:28.883078 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 29076
2026-08-08T14:44:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1410 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:28 dist-test-slave-mjjr krb5kdc[29218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:28 dist-test-slave-mjjr krb5kdc[29218](info): set up 2 sockets
Aug 08 14:44:28 dist-test-slave-mjjr krb5kdc[29218](info): commencing operation
krb5kdc: starting...
W20260808 14:44:30.069904 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:30 dist-test-slave-mjjr krb5kdc[29218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:30.181876 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:30.259507 29236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:30.259702 29236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:30.259724 29236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:30.260744 29236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:30.260779 29236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:30.260793 29236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:30.260805 29236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:30.260816 29236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:30.262172 29236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46511
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:30.262355 29236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:30.262506 29236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:30.267140 29246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:30.267166 29242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:30.267141 29243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:30.267187 29236 server_base.cc:1034] running on GCE node
I20260808 14:44:30.267620 29236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:30.267920 29236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:30.269062 29236 hybrid_clock.cc:648] HybridClock initialized: now 1786200270269048 us; error 29 us; skew 500 ppm
Aug 08 14:44:30 dist-test-slave-mjjr krb5kdc[29218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:30.271440 29236 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:30.271881 29236 webserver.cc:460] Webserver started at http://127.0.0.1:37185/ using document root <none> and password file <none>
I20260808 14:44:30.272094 29236 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:30.272154 29236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:30.272285 29236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:30.273216 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "23bacf24e93c4c40a99363b68b2bc553"
format_stamp: "Formatted at 2026-08-08 14:44:30 on dist-test-slave-mjjr"
server_key: "e7a17bbf66c30e2ca2932f485c4f6fd6"
server_key_iv: "02e6bf650066122383b568fb0da18823"
server_key_version: "encryptionkey@0"
I20260808 14:44:30.273600 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "23bacf24e93c4c40a99363b68b2bc553"
format_stamp: "Formatted at 2026-08-08 14:44:30 on dist-test-slave-mjjr"
server_key: "e7a17bbf66c30e2ca2932f485c4f6fd6"
server_key_iv: "02e6bf650066122383b568fb0da18823"
server_key_version: "encryptionkey@0"
I20260808 14:44:30.274919 29236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:30.275624 29254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:30.275830 29236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:30.275929 29236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "23bacf24e93c4c40a99363b68b2bc553"
format_stamp: "Formatted at 2026-08-08 14:44:30 on dist-test-slave-mjjr"
server_key: "e7a17bbf66c30e2ca2932f485c4f6fd6"
server_key_iv: "02e6bf650066122383b568fb0da18823"
server_key_version: "encryptionkey@0"
I20260808 14:44:30.276005 29236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:30.286787 29236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:30.288998 29236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:30.289166 29236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:30.293049 29236 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46511
I20260808 14:44:30.293079 29327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46511 every 8 connection(s)
I20260808 14:44:30.293408 29236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:30.294250 29328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:30.295979 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 29236
I20260808 14:44:30.296109 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:30.296288 30371 external_mini_cluster.cc:1428] Setting key cd8b51954ce9240688b90562766545fc
I20260808 14:44:30.296566 29328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553: Bootstrap starting.
I20260808 14:44:30.297297 29328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:30.297598 29328 log.cc:824] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:30.298286 29328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553: No bootstrap required, opened a new log
I20260808 14:44:30.300571 29328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bacf24e93c4c40a99363b68b2bc553" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46511 } }
I20260808 14:44:30.300717 29328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:30.300745 29328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23bacf24e93c4c40a99363b68b2bc553, State: Initialized, Role: FOLLOWER
I20260808 14:44:30.300856 29328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bacf24e93c4c40a99363b68b2bc553" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46511 } }
I20260808 14:44:30.300923 29328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:30.300949 29328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:30.300989 29328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:30.301571 29328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bacf24e93c4c40a99363b68b2bc553" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46511 } }
I20260808 14:44:30.301687 29328 leader_election.cc:302] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23bacf24e93c4c40a99363b68b2bc553; no voters:
I20260808 14:44:30.301905 29328 leader_election.cc:288] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:30.301961 29333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:30.302138 29333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [term 1 LEADER]: Becoming Leader. State: Replica: 23bacf24e93c4c40a99363b68b2bc553, State: Running, Role: LEADER
I20260808 14:44:30.302160 29328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:30.302300 29333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bacf24e93c4c40a99363b68b2bc553" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46511 } }
Aug 08 14:44:30 dist-test-slave-mjjr krb5kdc[29218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:44:30.303508 29335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23bacf24e93c4c40a99363b68b2bc553. Latest consensus state: current_term: 1 leader_uuid: "23bacf24e93c4c40a99363b68b2bc553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bacf24e93c4c40a99363b68b2bc553" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46511 } } }
I20260808 14:44:30.303591 29335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:30.303881 29334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23bacf24e93c4c40a99363b68b2bc553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23bacf24e93c4c40a99363b68b2bc553" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46511 } } }
I20260808 14:44:30.303964 29334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:30.304106 29353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:30.304579 29353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:30.306262 29353 catalog_manager.cc:1347] Generated new cluster ID: aed0f51d424b462989aebd9c66a7c299
I20260808 14:44:30.306310 29353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:30.308547 29331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:30.296806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:48035 (local address 127.0.0.1:46511)
0808 14:44:30.297001 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:30.297009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:30.297046 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:44:30.297633 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:30.297640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:30.297697 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:30.297844 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:30.298490 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:30.299893 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:30.300586 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:30.301136 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:30.301244 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:30.304313 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:30.304317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:30.304317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:30.304332 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:30.306305 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:30.306847 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:30.306850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:30.306851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:30.306959 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:30.307277 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:30.307278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:30.307278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:30.307564 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:30.307769 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:30.308259 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 14:44:30.308355 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260808 14:44:30.309441 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:30.314206 29353 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:30.314688 29353 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:30.319903 29331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:30.311047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:55027 (local address 127.0.0.1:46511)
0808 14:44:30.311082 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:30.311084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:30.311092 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:30.311110 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:30.311110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:30.311118 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:30.311162 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:30.311876 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:30.312873 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:30.313853 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:30.314136 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:30.314227 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:30.317003 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:30.317004 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:30.317004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:30.317012 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:30.318615 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:30.319002 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:30.319003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:30.319003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:30.319064 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:30.319328 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:30.319329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:30.319329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:30.319462 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:30.319567 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:30.319746 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 14:44:30.319814 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:44:30.328091 29353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23bacf24e93c4c40a99363b68b2bc553: Generated new TSK 0
I20260808 14:44:30.328240 29353 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:30.332285 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 29236
W20260808 14:44:30.344950 29215 connection.cc:535] client connection to 127.0.0.1:46511 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46511): Connection reset by peer (error 104)
2026-08-08T14:44:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:30 dist-test-slave-mjjr krb5kdc[29368](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:30 dist-test-slave-mjjr krb5kdc[29368](info): set up 2 sockets
Aug 08 14:44:30 dist-test-slave-mjjr krb5kdc[29368](info): commencing operation
krb5kdc: starting...
W20260808 14:44:31.508345 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:31 dist-test-slave-mjjr krb5kdc[29368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:31.620370 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:31.698572 29390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:31.698773 29390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:31.698808 29390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:31.699936 29390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:31.700001 29390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:31.700037 29390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:31.700063 29390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:31.700093 29390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:31.701403 29390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36375
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:31.701673 29390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:31.701892 29390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:31.706678 29397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:31.706811 29390 server_base.cc:1034] running on GCE node
W20260808 14:44:31.706738 29399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:31.706722 29396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:31.707176 29390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:31.707479 29390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:31.708642 29390 hybrid_clock.cc:648] HybridClock initialized: now 1786200271708634 us; error 39 us; skew 500 ppm
Aug 08 14:44:31 dist-test-slave-mjjr krb5kdc[29368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200271, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:31.711059 29390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:31.711498 29390 webserver.cc:460] Webserver started at http://127.0.0.1:37355/ using document root <none> and password file <none>
I20260808 14:44:31.711750 29390 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:31.711795 29390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:31.711880 29390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:31.712782 29390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "e9114294201b44eaa1e161dbcb2b2145"
format_stamp: "Formatted at 2026-08-08 14:44:31 on dist-test-slave-mjjr"
server_key: "d29b522e4b8c4bd2c96b81a3664402b9"
server_key_iv: "611ec00bd140e90b2d98b4fcfd281533"
server_key_version: "encryptionkey@0"
I20260808 14:44:31.713069 29390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "e9114294201b44eaa1e161dbcb2b2145"
format_stamp: "Formatted at 2026-08-08 14:44:31 on dist-test-slave-mjjr"
server_key: "d29b522e4b8c4bd2c96b81a3664402b9"
server_key_iv: "611ec00bd140e90b2d98b4fcfd281533"
server_key_version: "encryptionkey@0"
I20260808 14:44:31.714310 29390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:31.714946 29408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:31.715098 29390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:31.715175 29390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "e9114294201b44eaa1e161dbcb2b2145"
format_stamp: "Formatted at 2026-08-08 14:44:31 on dist-test-slave-mjjr"
server_key: "d29b522e4b8c4bd2c96b81a3664402b9"
server_key_iv: "611ec00bd140e90b2d98b4fcfd281533"
server_key_version: "encryptionkey@0"
I20260808 14:44:31.715229 29390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:31.748979 29390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:31.751017 29390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:31.751116 29390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:31.754914 29390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36375
I20260808 14:44:31.754932 29481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36375 every 8 connection(s)
I20260808 14:44:31.755285 29390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:31.756150 29483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:31.758195 29483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145: Bootstrap starting.
I20260808 14:44:31.758764 29483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:31.759043 29483 log.cc:824] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:31.759757 29483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145: No bootstrap required, opened a new log
I20260808 14:44:31.761256 29483 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9114294201b44eaa1e161dbcb2b2145" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 14:44:31.761408 29483 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:31.761469 29483 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9114294201b44eaa1e161dbcb2b2145, State: Initialized, Role: FOLLOWER
I20260808 14:44:31.761623 29483 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9114294201b44eaa1e161dbcb2b2145" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 14:44:31.761703 29483 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:31.761735 29483 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:31.761782 29483 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:31.762240 29483 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9114294201b44eaa1e161dbcb2b2145" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 14:44:31.762351 29483 leader_election.cc:302] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9114294201b44eaa1e161dbcb2b2145; no voters:
I20260808 14:44:31.762519 29483 leader_election.cc:288] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:31.762543 29486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:31.762679 29486 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [term 1 LEADER]: Becoming Leader. State: Replica: e9114294201b44eaa1e161dbcb2b2145, State: Running, Role: LEADER
I20260808 14:44:31.762753 29483 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:31.762801 29486 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9114294201b44eaa1e161dbcb2b2145" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 14:44:31.763180 29488 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9114294201b44eaa1e161dbcb2b2145. Latest consensus state: current_term: 1 leader_uuid: "e9114294201b44eaa1e161dbcb2b2145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9114294201b44eaa1e161dbcb2b2145" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } } }
I20260808 14:44:31.763288 29487 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9114294201b44eaa1e161dbcb2b2145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9114294201b44eaa1e161dbcb2b2145" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } } }
I20260808 14:44:31.763324 29488 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:31.763411 29487 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:31.763850 29497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:31.764276 29497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:31.765057 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 29390
I20260808 14:44:31.765179 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:31.765359 30371 external_mini_cluster.cc:1428] Setting key f8b1780461a661f8e341ab894c6e2893
I20260808 14:44:31.766330 29497 catalog_manager.cc:1347] Generated new cluster ID: 7cef24abdad647db95c1afbbbc41b4c6
I20260808 14:44:31.766384 29497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:31.771382 29513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:31.765787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:51349 (local address 127.0.0.1:36375)
0808 14:44:31.765955 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:31.765962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:31.765991 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:44:31.766154 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:31.766161 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:31.766215 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:31.766357 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:31.766719 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:31.768195 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:31.769203 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:31.769789 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:31.769914 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:31.770568 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:31.770572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:31.770572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:31.770775 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:31.770813 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:31.770826 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:31.770927 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:31.770997 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 14:44:31.771025 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260808 14:44:31.772492 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:31.777307 29513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:31.773885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:43271 (local address 127.0.0.1:36375)
0808 14:44:31.773944 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:31.773946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:31.774135 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:44:31.774179 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:31.774180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:31.774190 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:31.774241 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:31.774362 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:31.775070 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:31.776072 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:31.776392 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:31.776450 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:31.777072 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:31.777074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:31.777074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:31.777078 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:31.777090 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:31.777094 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:31.777147 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:31.777231 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:44:31.777242 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:44:31.780715 29497 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:31.781158 29497 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:31.783932 29497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9114294201b44eaa1e161dbcb2b2145: Generated new TSK 0
I20260808 14:44:31.784092 29497 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:31.788386 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 29390
W20260808 14:44:31.804059 29366 connection.cc:535] client connection to 127.0.0.1:36375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36375): Connection reset by peer (error 104)
2026-08-08T14:44:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:31 dist-test-slave-mjjr krb5kdc[29524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:31 dist-test-slave-mjjr krb5kdc[29524](info): set up 2 sockets
Aug 08 14:44:31 dist-test-slave-mjjr krb5kdc[29524](info): commencing operation
krb5kdc: starting...
W20260808 14:44:32.983309 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:33 dist-test-slave-mjjr krb5kdc[29524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:44:33.100142 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43935
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:33.177976 29542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:33.178181 29542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:33.178218 29542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:33.179287 29542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:33.179348 29542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:33.179373 29542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:33.179421 29542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:33.179450 29542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:33.180847 29542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43935
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:33.181090 29542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:33.181279 29542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:33.186090 29550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:33.186154 29542 server_base.cc:1034] running on GCE node
W20260808 14:44:33.186127 29553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:33.186127 29549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:33.186595 29542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:33.186875 29542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:33.188038 29542 hybrid_clock.cc:648] HybridClock initialized: now 1786200273188028 us; error 31 us; skew 500 ppm
Aug 08 14:44:33 dist-test-slave-mjjr krb5kdc[29524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:33.190490 29542 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:44:33.190866 29542 webserver.cc:460] Webserver started at http://127.0.0.1:41709/ using document root <none> and password file <none>
I20260808 14:44:33.191080 29542 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:33.191141 29542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:33.191277 29542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:33.192271 29542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "054c701de61045a68f282d7d7d18ca45"
format_stamp: "Formatted at 2026-08-08 14:44:33 on dist-test-slave-mjjr"
server_key: "63b78b265de7fb7dc5d5b13fab74487d"
server_key_iv: "afc8694713006f15b8529964b5110ae4"
server_key_version: "encryptionkey@0"
I20260808 14:44:33.192581 29542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "054c701de61045a68f282d7d7d18ca45"
format_stamp: "Formatted at 2026-08-08 14:44:33 on dist-test-slave-mjjr"
server_key: "63b78b265de7fb7dc5d5b13fab74487d"
server_key_iv: "afc8694713006f15b8529964b5110ae4"
server_key_version: "encryptionkey@0"
I20260808 14:44:33.193881 29542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:33.194635 29560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:33.194890 29542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:33.194988 29542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "054c701de61045a68f282d7d7d18ca45"
format_stamp: "Formatted at 2026-08-08 14:44:33 on dist-test-slave-mjjr"
server_key: "63b78b265de7fb7dc5d5b13fab74487d"
server_key_iv: "afc8694713006f15b8529964b5110ae4"
server_key_version: "encryptionkey@0"
I20260808 14:44:33.195065 29542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:33.198233 29542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:33.200310 29542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:33.200453 29542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:33.204258 29542 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43935
I20260808 14:44:33.204308 29635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43935 every 8 connection(s)
I20260808 14:44:33.204619 29542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:33.205559 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:33.207592 29636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45: Bootstrap starting.
I20260808 14:44:33.208163 29636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:33.208463 29636 log.cc:824] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:33.209124 29636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45: No bootstrap required, opened a new log
I20260808 14:44:33.210568 29636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "054c701de61045a68f282d7d7d18ca45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260808 14:44:33.210683 29636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:33.210729 29636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054c701de61045a68f282d7d7d18ca45, State: Initialized, Role: FOLLOWER
I20260808 14:44:33.210879 29636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "054c701de61045a68f282d7d7d18ca45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260808 14:44:33.210937 29636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:33.210955 29636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:33.211019 29636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:33.211510 29636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "054c701de61045a68f282d7d7d18ca45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260808 14:44:33.211616 29636 leader_election.cc:302] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 054c701de61045a68f282d7d7d18ca45; no voters:
I20260808 14:44:33.211807 29636 leader_election.cc:288] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:33.211854 29639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:33.212009 29639 raft_consensus.cc:686] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [term 1 LEADER]: Becoming Leader. State: Replica: 054c701de61045a68f282d7d7d18ca45, State: Running, Role: LEADER
I20260808 14:44:33.212077 29636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:33.212128 29639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "054c701de61045a68f282d7d7d18ca45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260808 14:44:33.212482 29642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 054c701de61045a68f282d7d7d18ca45. Latest consensus state: current_term: 1 leader_uuid: "054c701de61045a68f282d7d7d18ca45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "054c701de61045a68f282d7d7d18ca45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } } }
I20260808 14:44:33.212574 29642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:33.212590 29641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "054c701de61045a68f282d7d7d18ca45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "054c701de61045a68f282d7d7d18ca45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } } }
I20260808 14:44:33.212641 29641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:33.212811 29652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:33.213338 29652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:33.214440 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 29542
I20260808 14:44:33.214563 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:33.214771 30371 external_mini_cluster.cc:1428] Setting key 499da10c77cdd157efff9b15815e6257
I20260808 14:44:33.215390 29652 catalog_manager.cc:1347] Generated new cluster ID: aa8fbc70238b4092802bf3edaf68dbca
I20260808 14:44:33.215461 29652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:33.217127 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:33.215164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:52225 (local address 127.0.0.1:43935)
0808 14:44:33.215741 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:33.215764 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:33.215806 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:44:33.215892 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:33.215897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:33.215918 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:33.216053 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:33.216647 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:33.216650 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:33.216650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:33.216654 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:33.216697 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:33.216708 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:33.216773 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:33.216856 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:44:33.217009 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":70,"threads_started":1}
I20260808 14:44:33.220899 29652 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:33.221076 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:33.221087 29652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:33.224805 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:33.222416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.116:58631 (local address 127.0.0.1:43935)
0808 14:44:33.222451 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:33.222452 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:33.223879 (+ 1427us) server_negotiation.cc:407] Connection header received
0808 14:44:33.223956 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:33.223957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:33.223977 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:33.224036 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:33.224586 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:33.224588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:33.224588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:33.224592 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:33.224605 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:33.224608 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:33.224678 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:33.224733 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 14:44:33.224747 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:44:33.227208 29652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 054c701de61045a68f282d7d7d18ca45: Generated new TSK 0
I20260808 14:44:33.227361 29652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:33.230578 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 29542
2026-08-08T14:44:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:33 dist-test-slave-mjjr krb5kdc[29686](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:33 dist-test-slave-mjjr krb5kdc[29686](info): set up 2 sockets
Aug 08 14:44:33 dist-test-slave-mjjr krb5kdc[29686](info): commencing operation
krb5kdc: starting...
W20260808 14:44:34.400957 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:34 dist-test-slave-mjjr krb5kdc[29686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:34.510033 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37555
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:39907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:34.586963 29700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:34.587181 29700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:34.587221 29700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:34.588398 29700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:34.588464 29700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:34.588490 29700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:34.588519 29700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:34.588548 29700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:34.589983 29700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:39907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37555
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:34.590279 29700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:34.590507 29700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:34.594993 29713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:34.595005 29707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:34.595046 29700 server_base.cc:1034] running on GCE node
W20260808 14:44:34.595005 29709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:34.595443 29700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:34.595773 29700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:34.596931 29700 hybrid_clock.cc:648] HybridClock initialized: now 1786200274596918 us; error 43 us; skew 500 ppm
Aug 08 14:44:34 dist-test-slave-mjjr krb5kdc[29686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200274, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:34.602509 29700 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:34.602937 29700 webserver.cc:460] Webserver started at http://127.29.168.254:40833/ using document root <none> and password file <none>
I20260808 14:44:34.603153 29700 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:34.603214 29700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:34.603359 29700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:34.604406 29700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "94d60c06a4b7481097745bf92e945f68"
format_stamp: "Formatted at 2026-08-08 14:44:34 on dist-test-slave-mjjr"
server_key: "d64e6f0685dde3b398b5ec57d8f24e40"
server_key_iv: "7c4b02312cb6efbf380da27863745afb"
server_key_version: "encryptionkey@0"
I20260808 14:44:34.604753 29700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "94d60c06a4b7481097745bf92e945f68"
format_stamp: "Formatted at 2026-08-08 14:44:34 on dist-test-slave-mjjr"
server_key: "d64e6f0685dde3b398b5ec57d8f24e40"
server_key_iv: "7c4b02312cb6efbf380da27863745afb"
server_key_version: "encryptionkey@0"
I20260808 14:44:34.606024 29700 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:44:34.606736 29723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:34.606906 29700 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:44:34.607007 29700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "94d60c06a4b7481097745bf92e945f68"
format_stamp: "Formatted at 2026-08-08 14:44:34 on dist-test-slave-mjjr"
server_key: "d64e6f0685dde3b398b5ec57d8f24e40"
server_key_iv: "7c4b02312cb6efbf380da27863745afb"
server_key_version: "encryptionkey@0"
I20260808 14:44:34.607087 29700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:34.623328 29700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:34.625571 29700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:34.625741 29700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:34.629932 29700 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:37555
I20260808 14:44:34.629961 29795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:37555 every 8 connection(s)
I20260808 14:44:34.630323 29700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:34.631140 29796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:34.633216 29796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68: Bootstrap starting.
I20260808 14:44:34.633781 29796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:34.634043 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 29700
I20260808 14:44:34.634117 29796 log.cc:824] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:34.634162 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:34.634336 30371 external_mini_cluster.cc:1428] Setting key fc64452caff7c999b29fc67df2d8646a
I20260808 14:44:34.634990 29796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68: No bootstrap required, opened a new log
I20260808 14:44:34.637019 29796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d60c06a4b7481097745bf92e945f68" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37555 } }
I20260808 14:44:34.637162 29796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:34.637209 29796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d60c06a4b7481097745bf92e945f68, State: Initialized, Role: FOLLOWER
I20260808 14:44:34.637333 29796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d60c06a4b7481097745bf92e945f68" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37555 } }
I20260808 14:44:34.637427 29796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:34.637470 29796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:34.637517 29796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:34.638027 29796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d60c06a4b7481097745bf92e945f68" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37555 } }
I20260808 14:44:34.638162 29796 leader_election.cc:302] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94d60c06a4b7481097745bf92e945f68; no voters:
I20260808 14:44:34.638342 29796 leader_election.cc:288] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:34.638386 29802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:34.638532 29802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [term 1 LEADER]: Becoming Leader. State: Replica: 94d60c06a4b7481097745bf92e945f68, State: Running, Role: LEADER
I20260808 14:44:34.638586 29796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:34.638634 29802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d60c06a4b7481097745bf92e945f68" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37555 } }
I20260808 14:44:34.638971 29802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94d60c06a4b7481097745bf92e945f68. Latest consensus state: current_term: 1 leader_uuid: "94d60c06a4b7481097745bf92e945f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d60c06a4b7481097745bf92e945f68" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37555 } } }
I20260808 14:44:34.638981 29804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94d60c06a4b7481097745bf92e945f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d60c06a4b7481097745bf92e945f68" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37555 } } }
I20260808 14:44:34.639124 29804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:34.639351 29802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:34.640319 29808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 14:44:34 dist-test-slave-mjjr krb5kdc[29686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:34.640940 29808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:34.642369 29808 catalog_manager.cc:1347] Generated new cluster ID: 949e5db7a224428da0d56721e26657e8
I20260808 14:44:34.642423 29808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:34.644914 29801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:34.634821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48965 (local address 127.29.168.254:37555)
0808 14:44:34.635000 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:34.635009 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:34.635041 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:44:34.635427 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:34.635433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:34.635473 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:34.635605 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:34.636202 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:34.637052 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:34.637942 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:34.638464 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:34.638594 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:34.641362 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:34.641365 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:34.641366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:34.641375 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:34.643175 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:34.643603 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:34.643606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:34.643607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:34.643752 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:34.643992 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:34.643993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:34.643994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:34.644299 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:34.644464 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:34.644587 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 14:44:34.644690 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
I20260808 14:44:34.645834 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:34.651576 29808 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:34.652272 29808 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:34.654227 29801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:34.647275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57395 (local address 127.29.168.254:37555)
0808 14:44:34.647307 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:34.647309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:34.647357 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:44:34.647424 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:34.647424 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:34.647433 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:34.647501 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:34.648088 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:34.648784 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:34.649705 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:34.650036 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:34.650108 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:34.651385 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:34.651385 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:34.651386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:34.651392 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:34.652872 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:34.653330 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:34.653331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:34.653331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:34.653383 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:34.653623 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:34.653624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:34.653624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:34.653731 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:34.653820 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:34.654003 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:44:34.654062 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:34.657035 29808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94d60c06a4b7481097745bf92e945f68: Generated new TSK 0
I20260808 14:44:34.657208 29808 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:34.659477 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 29700
W20260808 14:44:34.668833 29684 connection.cc:535] client connection to 127.29.168.254:37555 recv error: Network error: failed to read from TLS socket (remote: 127.29.168.254:37555): Connection reset by peer (error 104)
2026-08-08T14:44:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:34 dist-test-slave-mjjr krb5kdc[29835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:34 dist-test-slave-mjjr krb5kdc[29835](info): set up 2 sockets
Aug 08 14:44:34 dist-test-slave-mjjr krb5kdc[29835](info): commencing operation
krb5kdc: starting...
W20260808 14:44:35.828534 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:35 dist-test-slave-mjjr krb5kdc[29835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:35.942003 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43491
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:37849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:43491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:36.023283 29853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:36.023545 29853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:36.023581 29853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:36.025460 29853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:36.025520 29853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:36.025544 29853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:36.025564 29853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:36.025612 29853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:36.028314 29853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:37849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:43491
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:36.029141 29853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:36.030253 29853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:36.035568 29861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:36.035607 29863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:36.035797 29853 server_base.cc:1034] running on GCE node
W20260808 14:44:36.035877 29859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:36.036126 29853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:36.036451 29853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:36.037590 29853 hybrid_clock.cc:648] HybridClock initialized: now 1786200276037566 us; error 41 us; skew 500 ppm
Aug 08 14:44:36 dist-test-slave-mjjr krb5kdc[29835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200276, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:36.040506 29853 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:36.040964 29853 webserver.cc:460] Webserver started at http://127.29.168.254:43899/ using document root <none> and password file <none>
I20260808 14:44:36.041215 29853 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:36.041281 29853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:36.041429 29853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:36.042412 29853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "d72fb7fbbd5641679fe939aeedb91ac4"
format_stamp: "Formatted at 2026-08-08 14:44:36 on dist-test-slave-mjjr"
server_key: "e8bc19f98d605ca21d82f9e67bd84b33"
server_key_iv: "eb455b9ce2b6e98791e13d463fe05959"
server_key_version: "encryptionkey@0"
I20260808 14:44:36.042768 29853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "d72fb7fbbd5641679fe939aeedb91ac4"
format_stamp: "Formatted at 2026-08-08 14:44:36 on dist-test-slave-mjjr"
server_key: "e8bc19f98d605ca21d82f9e67bd84b33"
server_key_iv: "eb455b9ce2b6e98791e13d463fe05959"
server_key_version: "encryptionkey@0"
I20260808 14:44:36.044286 29853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:36.045220 29872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:36.045430 29853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:36.045532 29853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "d72fb7fbbd5641679fe939aeedb91ac4"
format_stamp: "Formatted at 2026-08-08 14:44:36 on dist-test-slave-mjjr"
server_key: "e8bc19f98d605ca21d82f9e67bd84b33"
server_key_iv: "eb455b9ce2b6e98791e13d463fe05959"
server_key_version: "encryptionkey@0"
I20260808 14:44:36.045603 29853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:36.060328 29853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:36.062330 29853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:36.062484 29853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:36.068562 29853 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:43491
I20260808 14:44:36.068614 29944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:43491 every 8 connection(s)
I20260808 14:44:36.068974 29853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:36.070063 29945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:36.072924 29945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4: Bootstrap starting.
I20260808 14:44:36.073436 29945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:36.073679 29945 log.cc:824] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:36.074337 29945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4: No bootstrap required, opened a new log
I20260808 14:44:36.075987 29945 raft_consensus.cc:348] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43491 } }
I20260808 14:44:36.076118 29945 raft_consensus.cc:374] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:36.076138 29945 raft_consensus.cc:729] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72fb7fbbd5641679fe939aeedb91ac4, State: Initialized, Role: FOLLOWER
I20260808 14:44:36.076249 29945 consensus_queue.cc:260] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43491 } }
I20260808 14:44:36.076318 29945 raft_consensus.cc:388] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:36.076339 29945 raft_consensus.cc:482] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:36.076362 29945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:36.077109 29945 raft_consensus.cc:504] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43491 } }
I20260808 14:44:36.077188 29945 leader_election.cc:302] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d72fb7fbbd5641679fe939aeedb91ac4; no voters:
I20260808 14:44:36.077292 29945 leader_election.cc:288] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:36.077332 29948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:36.077482 29948 raft_consensus.cc:686] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [term 1 LEADER]: Becoming Leader. State: Replica: d72fb7fbbd5641679fe939aeedb91ac4, State: Running, Role: LEADER
I20260808 14:44:36.077557 29948 consensus_queue.cc:237] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43491 } }
I20260808 14:44:36.077580 29945 sys_catalog.cc:564] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:36.077864 29951 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d72fb7fbbd5641679fe939aeedb91ac4. Latest consensus state: current_term: 1 leader_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43491 } } }
I20260808 14:44:36.077952 29951 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:36.077953 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 29853
I20260808 14:44:36.078071 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:36.078107 29950 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d72fb7fbbd5641679fe939aeedb91ac4" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43491 } } }
I20260808 14:44:36.078171 29950 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:36.078277 29954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:36.078290 30371 external_mini_cluster.cc:1428] Setting key c29633d3a74a768837a8d3cc51f26119
I20260808 14:44:36.078785 29954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:36.080600 29954 catalog_manager.cc:1347] Generated new cluster ID: ea84c2e64ce04bb9ad38a24d3467a247
I20260808 14:44:36.080651 29954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:36.088486 29972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:36.078880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36721 (local address 127.29.168.254:43491)
0808 14:44:36.079532 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:36.079540 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:36.079572 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:44:36.079718 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:36.079725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:36.079775 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:36.079901 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:36.080117 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:36.085350 (+ 5233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:36.086373 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:36.086981 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:36.087074 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:36.087839 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:36.087844 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:36.087844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:36.088034 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:36.088067 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:36.088078 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:36.088148 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:36.088249 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 14:44:36.088269 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":68,"threads_started":1}
I20260808 14:44:36.089341 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:36.094905 29972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:36.090722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57687 (local address 127.29.168.254:43491)
0808 14:44:36.090768 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:36.090769 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:36.091794 (+ 1025us) server_negotiation.cc:407] Connection header received
0808 14:44:36.091823 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:36.091824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:36.091833 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:36.091897 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:36.092004 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:36.092685 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:36.093610 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:36.093945 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:36.094015 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:36.094656 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:36.094658 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:36.094658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:36.094663 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:36.094677 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:36.094681 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:36.094743 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:36.094812 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:44:36.094825 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:44:36.106009 29954 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:36.106454 29954 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:36.111395 29954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d72fb7fbbd5641679fe939aeedb91ac4: Generated new TSK 0
I20260808 14:44:36.111554 29954 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:36.119792 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 29853
W20260808 14:44:36.129263 29830 connection.cc:535] client connection to 127.29.168.254:43491 recv error: Network error: failed to read from TLS socket (remote: 127.29.168.254:43491): Connection reset by peer (error 104)
2026-08-08T14:44:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1460 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:36 dist-test-slave-mjjr krb5kdc[29987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:36 dist-test-slave-mjjr krb5kdc[29987](info): set up 2 sockets
Aug 08 14:44:36 dist-test-slave-mjjr krb5kdc[29987](info): commencing operation
krb5kdc: starting...
W20260808 14:44:37.289366 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:37 dist-test-slave-mjjr krb5kdc[29987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:37.400581 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43317
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:34871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:43317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:37.480984 30007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:37.481230 30007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:37.481276 30007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:37.482298 30007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:37.482360 30007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:37.482381 30007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:37.482399 30007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:37.482437 30007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:37.483855 30007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:34871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:43317
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:43317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:37.484144 30007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:37.484373 30007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:37.489180 30017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:37.489283 30014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:37.489187 30013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:37.489460 30007 server_base.cc:1034] running on GCE node
I20260808 14:44:37.489665 30007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:37.489930 30007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:37.491067 30007 hybrid_clock.cc:648] HybridClock initialized: now 1786200277491055 us; error 27 us; skew 500 ppm
Aug 08 14:44:37 dist-test-slave-mjjr krb5kdc[29987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200277, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:37.493757 30007 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:37.494165 30007 webserver.cc:460] Webserver started at http://127.29.168.254:45581/ using document root <none> and password file <none>
I20260808 14:44:37.494398 30007 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:37.494441 30007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:37.494525 30007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:37.495517 30007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "2be4e331e588450198f9df133192f5b3"
format_stamp: "Formatted at 2026-08-08 14:44:37 on dist-test-slave-mjjr"
server_key: "6a44e4af3c00228a51dd69af604fb463"
server_key_iv: "8aaa72caf0591eda96204bff6f8aca26"
server_key_version: "encryptionkey@0"
I20260808 14:44:37.495878 30007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "2be4e331e588450198f9df133192f5b3"
format_stamp: "Formatted at 2026-08-08 14:44:37 on dist-test-slave-mjjr"
server_key: "6a44e4af3c00228a51dd69af604fb463"
server_key_iv: "8aaa72caf0591eda96204bff6f8aca26"
server_key_version: "encryptionkey@0"
I20260808 14:44:37.497117 30007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:37.497851 30027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:37.498004 30007 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:37.498087 30007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "2be4e331e588450198f9df133192f5b3"
format_stamp: "Formatted at 2026-08-08 14:44:37 on dist-test-slave-mjjr"
server_key: "6a44e4af3c00228a51dd69af604fb463"
server_key_iv: "8aaa72caf0591eda96204bff6f8aca26"
server_key_version: "encryptionkey@0"
I20260808 14:44:37.498137 30007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:37.501246 30007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:37.503283 30007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:37.503383 30007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:37.507248 30007 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:43317
I20260808 14:44:37.507314 30102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:43317 every 8 connection(s)
I20260808 14:44:37.507624 30007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:37.508701 30104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:37.510978 30104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3: Bootstrap starting.
I20260808 14:44:37.511565 30104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:37.511880 30104 log.cc:824] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:37.512591 30104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3: No bootstrap required, opened a new log
I20260808 14:44:37.514191 30104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2be4e331e588450198f9df133192f5b3" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43317 } }
I20260808 14:44:37.514345 30104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:37.514392 30104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be4e331e588450198f9df133192f5b3, State: Initialized, Role: FOLLOWER
I20260808 14:44:37.514549 30104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2be4e331e588450198f9df133192f5b3" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43317 } }
I20260808 14:44:37.514649 30104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:37.514657 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30007
I20260808 14:44:37.514683 30104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:37.514735 30104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:37.514765 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:37.514961 30371 external_mini_cluster.cc:1428] Setting key 406ece85162a08a07bf743854a659e49
I20260808 14:44:37.515872 30104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2be4e331e588450198f9df133192f5b3" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43317 } }
I20260808 14:44:37.516006 30104 leader_election.cc:302] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2be4e331e588450198f9df133192f5b3; no voters:
I20260808 14:44:37.516181 30104 leader_election.cc:288] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:37.516232 30112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:37.516383 30112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [term 1 LEADER]: Becoming Leader. State: Replica: 2be4e331e588450198f9df133192f5b3, State: Running, Role: LEADER
I20260808 14:44:37.516502 30104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:37.516520 30112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2be4e331e588450198f9df133192f5b3" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43317 } }
I20260808 14:44:37.516934 30112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2be4e331e588450198f9df133192f5b3. Latest consensus state: current_term: 1 leader_uuid: "2be4e331e588450198f9df133192f5b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2be4e331e588450198f9df133192f5b3" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43317 } } }
I20260808 14:44:37.517006 30118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2be4e331e588450198f9df133192f5b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2be4e331e588450198f9df133192f5b3" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 43317 } } }
I20260808 14:44:37.517163 30118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:37.517258 30111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:37.515459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36905 (local address 127.29.168.254:43317)
0808 14:44:37.515674 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:37.515684 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:37.515716 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:44:37.515819 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:37.515824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:37.515856 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:37.515986 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:37.516660 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:37.516663 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:37.516664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:37.516668 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:37.516711 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:37.516724 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:37.516794 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:37.516888 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:44:37.516929 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":113,"threads_started":1}
I20260808 14:44:37.517055 30112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:37.517417 30126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:37.518114 30126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:37.518325 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:37.520709 30126 catalog_manager.cc:1347] Generated new cluster ID: 5b22f1959f5b41a9b6e0193867a73d90
I20260808 14:44:37.520767 30126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:37.521009 30111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:37.519846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43493 (local address 127.29.168.254:43317)
0808 14:44:37.519882 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:37.519894 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:37.520133 (+ 239us) server_negotiation.cc:407] Connection header received
0808 14:44:37.520185 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:37.520185 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:37.520190 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:37.520250 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:37.520775 (+ 525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:37.520776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:37.520776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:37.520780 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:37.520794 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:37.520798 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:37.520829 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:37.520936 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:44:37.520949 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:44:37.542702 30126 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:37.542894 30126 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:37.546857 30126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2be4e331e588450198f9df133192f5b3: Generated new TSK 0
I20260808 14:44:37.547025 30126 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:37.549384 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30007
2026-08-08T14:44:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:37 dist-test-slave-mjjr krb5kdc[30155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:37 dist-test-slave-mjjr krb5kdc[30155](info): set up 2 sockets
Aug 08 14:44:37 dist-test-slave-mjjr krb5kdc[30155](info): commencing operation
krb5kdc: starting...
W20260808 14:44:38.725982 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:38 dist-test-slave-mjjr krb5kdc[30155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:38.841871 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41869
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:41869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:38.920367 30178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:38.920547 30178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:38.920568 30178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:38.921607 30178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:38.921639 30178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:38.921653 30178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:38.921664 30178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:38.921676 30178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:38.923032 30178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:41869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:41869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:38.923190 30178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:38.923365 30178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:38.928013 30190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:38.928026 30187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:38.928133 30186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:38.928131 30178 server_base.cc:1034] running on GCE node
I20260808 14:44:38.928413 30178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:38.928687 30178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:38.929850 30178 hybrid_clock.cc:648] HybridClock initialized: now 1786200278929844 us; error 35 us; skew 500 ppm
Aug 08 14:44:38 dist-test-slave-mjjr krb5kdc[30155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200278, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:38.932331 30178 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:38.932801 30178 webserver.cc:460] Webserver started at http://127.29.168.254:32801/ using document root <none> and password file <none>
I20260808 14:44:38.933034 30178 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:38.933100 30178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:38.933246 30178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:38.934280 30178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "5a502b1812ca4ffbab4b31b54ebfa376"
format_stamp: "Formatted at 2026-08-08 14:44:38 on dist-test-slave-mjjr"
server_key: "2b72c096003fe8fe968a1d5bf88f451c"
server_key_iv: "7720b6aa8296de241ec141138b3f9a12"
server_key_version: "encryptionkey@0"
I20260808 14:44:38.934803 30178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "5a502b1812ca4ffbab4b31b54ebfa376"
format_stamp: "Formatted at 2026-08-08 14:44:38 on dist-test-slave-mjjr"
server_key: "2b72c096003fe8fe968a1d5bf88f451c"
server_key_iv: "7720b6aa8296de241ec141138b3f9a12"
server_key_version: "encryptionkey@0"
I20260808 14:44:38.936295 30178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:38.937060 30198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:38.937263 30178 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:38.937391 30178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "5a502b1812ca4ffbab4b31b54ebfa376"
format_stamp: "Formatted at 2026-08-08 14:44:38 on dist-test-slave-mjjr"
server_key: "2b72c096003fe8fe968a1d5bf88f451c"
server_key_iv: "7720b6aa8296de241ec141138b3f9a12"
server_key_version: "encryptionkey@0"
I20260808 14:44:38.937471 30178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:38.952672 30178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:38.954927 30178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:38.955090 30178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:38.959309 30178 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:41869
I20260808 14:44:38.959343 30274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:41869 every 8 connection(s)
I20260808 14:44:38.959707 30178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:38.960569 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:38.962860 30275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376: Bootstrap starting.
I20260808 14:44:38.963441 30275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:38.963744 30275 log.cc:824] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:38.964466 30275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376: No bootstrap required, opened a new log
I20260808 14:44:38.966137 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30178
I20260808 14:44:38.966053 30275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41869 } }
I20260808 14:44:38.966205 30275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:38.966229 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:38.966254 30275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a502b1812ca4ffbab4b31b54ebfa376, State: Initialized, Role: FOLLOWER
I20260808 14:44:38.966404 30275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41869 } }
I20260808 14:44:38.966493 30371 external_mini_cluster.cc:1428] Setting key 0158eabc2a15c2d4bca03771d2a56f36
I20260808 14:44:38.966506 30275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:38.966568 30275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:38.966617 30275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:38.967371 30275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41869 } }
I20260808 14:44:38.967496 30275 leader_election.cc:302] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a502b1812ca4ffbab4b31b54ebfa376; no voters:
I20260808 14:44:38.967685 30275 leader_election.cc:288] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:38.967715 30282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:38.967829 30282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [term 1 LEADER]: Becoming Leader. State: Replica: 5a502b1812ca4ffbab4b31b54ebfa376, State: Running, Role: LEADER
I20260808 14:44:38.967959 30275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:38.967975 30282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41869 } }
I20260808 14:44:38.968433 30283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41869 } } }
I20260808 14:44:38.968521 30283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:38.968477 30286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a502b1812ca4ffbab4b31b54ebfa376. Latest consensus state: current_term: 1 leader_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a502b1812ca4ffbab4b31b54ebfa376" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 41869 } } }
I20260808 14:44:38.968565 30286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:38.969429 30298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:38.970029 30298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:38.971429 30298 catalog_manager.cc:1347] Generated new cluster ID: f31f11ce84ac467bbbc380910d2b52d3
I20260808 14:44:38.971479 30298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:38 dist-test-slave-mjjr krb5kdc[30155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:38.978363 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:38.967005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50001 (local address 127.29.168.254:41869)
0808 14:44:38.967521 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:38.967529 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:38.967557 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:44:38.967709 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:38.967715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:38.967804 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:38.968777 (+ 973us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:38.968883 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:38.970283 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:38.971207 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:38.971812 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:38.971922 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:38.974740 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:38.974744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:38.974744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:38.974756 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:38.976745 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:38.977110 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:38.977113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:38.977113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:38.977250 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:38.977462 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:38.977464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:38.977464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:38.977808 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:38.977966 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:38.978039 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:44:38.978168 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":423,"threads_started":1}
I20260808 14:44:38.979316 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:38.987201 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:38.980650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59609 (local address 127.29.168.254:41869)
0808 14:44:38.980682 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:38.980684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:38.980710 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:44:38.980752 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:38.980753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:38.980763 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:38.980832 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:38.981336 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:38.982085 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:38.982969 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:38.983282 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:38.983346 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:38.984537 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:38.984539 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:38.984539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:38.984545 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:38.986087 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:38.986437 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:38.986438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:38.986439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:38.986526 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:38.986727 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:38.986728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:38.986728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:38.986856 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:38.986947 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:38.987049 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 14:44:38.987118 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:44:38.989003 30298 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:38.989466 30298 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:38.993548 30298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a502b1812ca4ffbab4b31b54ebfa376: Generated new TSK 0
I20260808 14:44:38.993706 30298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:39.001850 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30178
2026-08-08T14:44:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1455 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:39 dist-test-slave-mjjr krb5kdc[30317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:39 dist-test-slave-mjjr krb5kdc[30317](info): set up 2 sockets
Aug 08 14:44:39 dist-test-slave-mjjr krb5kdc[30317](info): commencing operation
krb5kdc: starting...
W20260808 14:44:40.184645 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:40 dist-test-slave-mjjr krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:40.294090 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36669
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:40709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:36669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:40.372706 30333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:40.372897 30333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:40.372920 30333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:40.373906 30333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:40.373945 30333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:40.373961 30333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:40.373974 30333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:40.373987 30333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:40.375401 30333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:40709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:36669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:36669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:40.375584 30333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:40.375816 30333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:40.380224 30338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:40.380215 30346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:40.380414 30333 server_base.cc:1034] running on GCE node
W20260808 14:44:40.380203 30340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:40.380730 30333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:40.380997 30333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:40.382138 30333 hybrid_clock.cc:648] HybridClock initialized: now 1786200280382119 us; error 33 us; skew 500 ppm
Aug 08 14:44:40 dist-test-slave-mjjr krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200280, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:40.388484 30333 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:40.388921 30333 webserver.cc:460] Webserver started at http://127.29.168.254:35015/ using document root <none> and password file <none>
I20260808 14:44:40.389117 30333 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:40.389178 30333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:40.389310 30333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:40.390185 30333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "067b071f6a91455e9558b5bccd0d7dfd"
format_stamp: "Formatted at 2026-08-08 14:44:40 on dist-test-slave-mjjr"
server_key: "c753b37af77025ff44e1f075f3b4e72c"
server_key_iv: "e5e4607475efc7b861afc7844eee8118"
server_key_version: "encryptionkey@0"
I20260808 14:44:40.390511 30333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "067b071f6a91455e9558b5bccd0d7dfd"
format_stamp: "Formatted at 2026-08-08 14:44:40 on dist-test-slave-mjjr"
server_key: "c753b37af77025ff44e1f075f3b4e72c"
server_key_iv: "e5e4607475efc7b861afc7844eee8118"
server_key_version: "encryptionkey@0"
I20260808 14:44:40.391880 30333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:44:40.392598 30353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:40.392762 30333 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:40.392860 30333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "067b071f6a91455e9558b5bccd0d7dfd"
format_stamp: "Formatted at 2026-08-08 14:44:40 on dist-test-slave-mjjr"
server_key: "c753b37af77025ff44e1f075f3b4e72c"
server_key_iv: "e5e4607475efc7b861afc7844eee8118"
server_key_version: "encryptionkey@0"
I20260808 14:44:40.392939 30333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:40.411489 30333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:40.413154 30333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:40.413313 30333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:40.417457 30333 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:36669
I20260808 14:44:40.417488 30439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:36669 every 8 connection(s)
I20260808 14:44:40.417827 30333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:40.418288 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30333
I20260808 14:44:40.418408 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:40.418572 30371 external_mini_cluster.cc:1428] Setting key ed799950dd5a0fd56ecbda5fd99ecd06
I20260808 14:44:40.418810 30440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:40.421787 30440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd: Bootstrap starting.
I20260808 14:44:40.422369 30440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:40.422703 30440 log.cc:824] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:40.423511 30440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd: No bootstrap required, opened a new log
I20260808 14:44:40.423846 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:40.419056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45707 (local address 127.29.168.254:36669)
0808 14:44:40.419245 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:40.419253 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:40.419284 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:44:40.419912 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:40.419919 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:40.419968 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:40.420076 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:40.420294 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:40.421076 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:40.422066 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:40.422430 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:40.422545 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:40.423168 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:40.423173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:40.423173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:40.423374 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:40.423404 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:40.423414 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:40.423471 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:40.423588 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:44:40.423680 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260808 14:44:40.424862 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:40.425779 30440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067b071f6a91455e9558b5bccd0d7dfd" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36669 } }
I20260808 14:44:40.425920 30440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:40.425961 30440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 067b071f6a91455e9558b5bccd0d7dfd, State: Initialized, Role: FOLLOWER
I20260808 14:44:40.426080 30440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067b071f6a91455e9558b5bccd0d7dfd" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36669 } }
I20260808 14:44:40.426178 30440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:40.426241 30440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:40.426326 30440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:40.426834 30440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067b071f6a91455e9558b5bccd0d7dfd" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36669 } }
I20260808 14:44:40.426924 30440 leader_election.cc:302] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 067b071f6a91455e9558b5bccd0d7dfd; no voters:
I20260808 14:44:40.427037 30440 leader_election.cc:288] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:40.427124 30453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:40.427273 30453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [term 1 LEADER]: Becoming Leader. State: Replica: 067b071f6a91455e9558b5bccd0d7dfd, State: Running, Role: LEADER
I20260808 14:44:40.427278 30440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:40.427467 30453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067b071f6a91455e9558b5bccd0d7dfd" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36669 } }
I20260808 14:44:40.428459 30454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "067b071f6a91455e9558b5bccd0d7dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067b071f6a91455e9558b5bccd0d7dfd" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36669 } } }
I20260808 14:44:40.428550 30454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:40.428721 30455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 067b071f6a91455e9558b5bccd0d7dfd. Latest consensus state: current_term: 1 leader_uuid: "067b071f6a91455e9558b5bccd0d7dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "067b071f6a91455e9558b5bccd0d7dfd" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 36669 } } }
W20260808 14:44:40.429273 30471 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 14:44:40.429634 30455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd [sys.catalog]: This master's current role is: LEADER
W20260808 14:44:40.429644 30471 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:40.429735 30472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:40.429957 30472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:40.430876 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:40.426245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46227 (local address 127.29.168.254:36669)
0808 14:44:40.426287 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:40.426289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:40.427407 (+ 1118us) server_negotiation.cc:407] Connection header received
0808 14:44:40.427517 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:40.427517 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:40.427527 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:40.427555 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:40.427752 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:40.428489 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:40.429487 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:40.429818 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:40.429912 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:40.430594 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:40.430595 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:40.430595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:40.430600 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:40.430629 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:40.430634 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:40.430690 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:40.430755 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:44:40.430774 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:44:40.431620 30472 catalog_manager.cc:1347] Generated new cluster ID: 12a9824271be4ac5ba037b56ad42d624
I20260808 14:44:40.431692 30472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:40.452019 30472 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:40.452505 30472 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:40.464089 30472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 067b071f6a91455e9558b5bccd0d7dfd: Generated new TSK 0
I20260808 14:44:40.464267 30472 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:40.468608 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30333
2026-08-08T14:44:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:40 dist-test-slave-mjjr krb5kdc[30477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:40 dist-test-slave-mjjr krb5kdc[30477](info): set up 2 sockets
Aug 08 14:44:40 dist-test-slave-mjjr krb5kdc[30477](info): commencing operation
krb5kdc: starting...
W20260808 14:44:41.634183 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:41 dist-test-slave-mjjr krb5kdc[30477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:41.749492 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33037
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:40227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:33037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:41.827610 30493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:41.827826 30493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:41.827847 30493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:41.828902 30493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:41.828939 30493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:41.828953 30493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:41.828998 30493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:41.829020 30493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:41.830456 30493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:40227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:33037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:33037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:41.830698 30493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:41.830926 30493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:41.835371 30501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:41.835427 30493 server_base.cc:1034] running on GCE node
W20260808 14:44:41.835392 30500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:41.835389 30503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:41.835877 30493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:41.836143 30493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:41.837288 30493 hybrid_clock.cc:648] HybridClock initialized: now 1786200281837276 us; error 32 us; skew 500 ppm
Aug 08 14:44:41 dist-test-slave-mjjr krb5kdc[30477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200281, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:41.839468 30493 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:41.839885 30493 webserver.cc:460] Webserver started at http://127.29.168.254:41269/ using document root <none> and password file <none>
I20260808 14:44:41.840062 30493 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:41.840098 30493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:41.840179 30493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:41.841074 30493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "f9e3481f17eb421ea3a3f1a79541a7cf"
format_stamp: "Formatted at 2026-08-08 14:44:41 on dist-test-slave-mjjr"
server_key: "995edb349ece162e986a95f757c1a02f"
server_key_iv: "09dcab69c820cea28f23aae6bb89b552"
server_key_version: "encryptionkey@0"
I20260808 14:44:41.841333 30493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "f9e3481f17eb421ea3a3f1a79541a7cf"
format_stamp: "Formatted at 2026-08-08 14:44:41 on dist-test-slave-mjjr"
server_key: "995edb349ece162e986a95f757c1a02f"
server_key_iv: "09dcab69c820cea28f23aae6bb89b552"
server_key_version: "encryptionkey@0"
I20260808 14:44:41.842514 30493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:41.843097 30511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:41.843263 30493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:41.843345 30493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "f9e3481f17eb421ea3a3f1a79541a7cf"
format_stamp: "Formatted at 2026-08-08 14:44:41 on dist-test-slave-mjjr"
server_key: "995edb349ece162e986a95f757c1a02f"
server_key_iv: "09dcab69c820cea28f23aae6bb89b552"
server_key_version: "encryptionkey@0"
I20260808 14:44:41.843397 30493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:41.846549 30493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:41.848311 30493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:41.848412 30493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:41.852109 30493 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:33037
I20260808 14:44:41.852135 30591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:33037 every 8 connection(s)
I20260808 14:44:41.852480 30493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:41.853396 30592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:41.853906 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30493
I20260808 14:44:41.853979 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:41.854161 30371 external_mini_cluster.cc:1428] Setting key b374f11eb4e43c04b240bfdd7deb8a05
I20260808 14:44:41.856326 30592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf: Bootstrap starting.
I20260808 14:44:41.856745 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:41.854662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50123 (local address 127.29.168.254:33037)
0808 14:44:41.854850 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:41.854860 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:41.854891 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:44:41.855415 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:41.855424 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:41.855455 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:41.855604 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:41.856218 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:41.856221 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:41.856222 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:41.856226 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:41.856264 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:41.856277 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:41.856352 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:41.856421 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:44:41.856550 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260808 14:44:41.857013 30592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:41.857342 30592 log.cc:824] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:41.857707 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:41.857995 30592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf: No bootstrap required, opened a new log
I20260808 14:44:41.859920 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:41.859035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55157 (local address 127.29.168.254:33037)
0808 14:44:41.859085 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:41.859086 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:41.859094 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:41.859167 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:41.859168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:41.859171 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:41.859226 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:41.859735 (+ 509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:41.859736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:41.859736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:44:41.859740 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:41.859751 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:44:41.859754 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:41.859799 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:41.859855 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:44:41.859865 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:44:41.860045 30592 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33037 } }
I20260808 14:44:41.860184 30592 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:41.860205 30592 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e3481f17eb421ea3a3f1a79541a7cf, State: Initialized, Role: FOLLOWER
I20260808 14:44:41.860324 30592 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33037 } }
I20260808 14:44:41.860409 30592 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:41.860461 30592 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:41.860522 30592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:41.860975 30592 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33037 } }
I20260808 14:44:41.861076 30592 leader_election.cc:302] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9e3481f17eb421ea3a3f1a79541a7cf; no voters:
I20260808 14:44:41.861217 30592 leader_election.cc:288] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:41.861245 30607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:41.861393 30607 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [term 1 LEADER]: Becoming Leader. State: Replica: f9e3481f17eb421ea3a3f1a79541a7cf, State: Running, Role: LEADER
I20260808 14:44:41.861431 30592 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:41.861542 30607 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33037 } }
I20260808 14:44:41.862110 30610 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9e3481f17eb421ea3a3f1a79541a7cf. Latest consensus state: current_term: 1 leader_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33037 } } }
I20260808 14:44:41.862033 30609 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e3481f17eb421ea3a3f1a79541a7cf" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 33037 } } }
I20260808 14:44:41.862280 30609 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:41.862344 30610 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:41.862880 30622 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:41.863488 30622 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:41.870477 30622 catalog_manager.cc:1347] Generated new cluster ID: e72ff827638c4fab9ec841429c2974e5
I20260808 14:44:41.870548 30622 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:41.879745 30622 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:41.879886 30622 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:41.882943 30622 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9e3481f17eb421ea3a3f1a79541a7cf: Generated new TSK 0
I20260808 14:44:41.883102 30622 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:41.885469 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30493
2026-08-08T14:44:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1414 ms)
[----------] 18 tests from AuthTokenIssuingTest (26097 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:41 dist-test-slave-mjjr krb5kdc[30635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:41 dist-test-slave-mjjr krb5kdc[30635](info): set up 2 sockets
Aug 08 14:44:41 dist-test-slave-mjjr krb5kdc[30635](info): commencing operation
krb5kdc: starting...
W20260808 14:44:43.072907 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:43.184461 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39559
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:39559,127.29.168.253:45711,127.29.168.252:42041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:43.261212 30654 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:44:43.261433 30654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:43.261482 30654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:43.261536 30654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:43.262584 30654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:43.262648 30654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:43.262668 30654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:43.262696 30654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:43.262718 30654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:43.264109 30654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:39559,127.29.168.253:45711,127.29.168.252:42041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:43.264349 30654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:43.264593 30654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:43.269145 30663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:43.269146 30661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:43.269275 30665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:43.269526 30654 server_base.cc:1034] running on GCE node
I20260808 14:44:43.269766 30654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:43.270017 30654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:43.271168 30654 hybrid_clock.cc:648] HybridClock initialized: now 1786200283271155 us; error 30 us; skew 500 ppm
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:43.273561 30654 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:43.273986 30654 webserver.cc:460] Webserver started at http://127.29.168.254:40163/ using document root <none> and password file <none>
I20260808 14:44:43.274196 30654 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:43.274264 30654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:43.274427 30654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:43.275408 30654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "6433d81b082c4751af12a3fd0afd37f6"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "7251d41844f99524eed07f8bace49ab6"
server_key_iv: "1d6f4d76eabc78a11cbb4f8b5de9a130"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.275792 30654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "6433d81b082c4751af12a3fd0afd37f6"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "7251d41844f99524eed07f8bace49ab6"
server_key_iv: "1d6f4d76eabc78a11cbb4f8b5de9a130"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.277117 30654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:43.277822 30673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:43.278030 30654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:43.278131 30654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "6433d81b082c4751af12a3fd0afd37f6"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "7251d41844f99524eed07f8bace49ab6"
server_key_iv: "1d6f4d76eabc78a11cbb4f8b5de9a130"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.278201 30654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:43.294281 30654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:43.295953 30654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:43.296092 30654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:43.299978 30654 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:39559
I20260808 14:44:43.300012 30746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:39559 every 8 connection(s)
I20260808 14:44:43.300329 30654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:43.301126 30747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:43.302457 30747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:43.309091 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30654
I20260808 14:44:43.309204 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:43.309414 30371 external_mini_cluster.cc:1428] Setting key 587bfe326ed3bf0ec4fa55a186ceb09c
I20260808 14:44:43.311533 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.303023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39559 (local address 127.0.0.1:45024)
0808 14:44:43.303139 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.303167 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.303574 (+ 407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.303829 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.303831 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.304048 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.304205 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.304209 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.305165 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.305166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.305818 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.305819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.306220 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.306221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.306288 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.306793 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.306801 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.308158 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.310160 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.310166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.310167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.310334 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.310605 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.310606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.310606 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.310676 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.311067 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.311071 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.311127 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.311206 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.311360 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":62,"threads_started":1}
I20260808 14:44:43.311635 30751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.303159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45024 (local address 127.29.168.254:39559)
0808 14:44:43.303277 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.303281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.303315 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:44:43.303735 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.303736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.303753 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.303824 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.304286 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.305088 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.305884 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.306154 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.306223 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.308235 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.308243 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.308243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.308249 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.310089 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.310407 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.310409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.310410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.310537 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.310728 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.310729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.310729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.310993 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.311072 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.311260 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.311470 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":90,"thread_start_us":59,"threads_started":1}
I20260808 14:44:43.312287 30747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:43.312592 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.312500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40308)
0808 14:44:43.312540 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.312576 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:44:43.312737 30678 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
I20260808 14:44:43.313105 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.313018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40322)
0808 14:44:43.313062 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.313085 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:44:43.313206 30747 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:45711: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.29.168.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab.
Entry for principal kudu/127.29.168.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab.
I20260808 14:44:43.332563 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:45711
--webserver_interface=127.29.168.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab
--principal=kudu/127.29.168.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:39559,127.29.168.253:45711,127.29.168.252:42041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:44:43.362409 30747 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } attempt: 1
I20260808 14:44:43.362911 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.362773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40326)
0808 14:44:43.362832 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.362870 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:44:43.363317 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.363208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40328)
0808 14:44:43.363257 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.363282 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:44:43.363409 30747 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:45711: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
W20260808 14:44:43.412281 30757 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:44:43.412448 30757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:43.412463 30757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:43.412480 30757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:43.413502 30757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:43.413539 30757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:43.413552 30757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:43.413564 30757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:43.413606 30757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:43.415035 30757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:39559,127.29.168.253:45711,127.29.168.252:42041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab
--principal=kudu/127.29.168.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:45711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.168.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:43.415267 30757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:43.415479 30757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:43.419945 30764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:43.419945 30768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:43.420044 30765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:43.420110 30757 server_base.cc:1034] running on GCE node
I20260808 14:44:43.420435 30757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:43.420708 30757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:43.421861 30757 hybrid_clock.cc:648] HybridClock initialized: now 1786200283421851 us; error 39 us; skew 500 ppm
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:43.424256 30757 init.cc:377] Logged in from keytab as kudu/127.29.168.253@KRBTEST.COM (short username kudu)
I20260808 14:44:43.424715 30757 webserver.cc:460] Webserver started at http://127.29.168.253:39675/ using document root <none> and password file <none>
I20260808 14:44:43.424929 30757 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:43.424993 30757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:43.425133 30757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:43.426162 30757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data/instance:
uuid: "72a2f587773542cbb449d136cdf4fa91"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "c578fef62ba1ce714a4e4f1df782eb99"
server_key_iv: "16bab327c52d24bff40dfd7980f81484"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.426514 30757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal/instance:
uuid: "72a2f587773542cbb449d136cdf4fa91"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "c578fef62ba1ce714a4e4f1df782eb99"
server_key_iv: "16bab327c52d24bff40dfd7980f81484"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.427908 30757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:44:43.428577 30777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:43.428738 30757 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:43.428831 30757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal
uuid: "72a2f587773542cbb449d136cdf4fa91"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "c578fef62ba1ce714a4e4f1df782eb99"
server_key_iv: "16bab327c52d24bff40dfd7980f81484"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.428905 30757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:43.431556 30747 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } attempt: 2
I20260808 14:44:43.432022 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.431871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40344)
0808 14:44:43.431931 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.431979 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:44:43.432375 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.432284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40350)
0808 14:44:43.432326 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.432356 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 14:44:43.432492 30747 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:45711: Network error: Client connection negotiation failed: client connection to 127.29.168.253:45711: connect: Connection refused (error 111)
I20260808 14:44:43.449950 30757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:43.451753 30757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:43.451911 30757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:43.455767 30757 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.253:45711
I20260808 14:44:43.455801 30853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.253:45711 every 8 connection(s)
I20260808 14:44:43.456139 30757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
I20260808 14:44:43.456947 30854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:43.457149 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30757
I20260808 14:44:43.457258 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-1/wal/instance
I20260808 14:44:43.457471 30371 external_mini_cluster.cc:1428] Setting key ef52d4dc018be45b60646537dda8c1b3
I20260808 14:44:43.459311 30854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.168.252@KRBTEST.COM; defaulting to no policy
I20260808 14:44:43.468124 30751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.460092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45036 (local address 127.29.168.254:39559)
0808 14:44:43.460145 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.460147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.460358 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:44:43.460848 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.460849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.460864 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.460910 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.461548 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.462083 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.463054 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.463269 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.463354 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.465429 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.465431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.465432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.465440 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.466758 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.467149 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.467150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.467151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.467209 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.467450 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.467451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.467451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.467559 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.467634 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.467927 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.468040 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:44:43.468295 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.460092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39559 (local address 127.0.0.1:45036)
0808 14:44:43.460236 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.460268 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.460745 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.461000 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.461003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.461250 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.461456 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.461460 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.462185 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.462186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.462967 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.462969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.463386 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.463387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.463505 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.464019 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.464027 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.465334 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.466851 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.466858 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.466860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.467073 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.467284 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.467284 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.467285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.467387 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.467626 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.467633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.467795 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.467906 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.468081 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.252@KRBTEST.COM" created.
I20260808 14:44:43.468834 30854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:43.475482 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.469096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40352)
0808 14:44:43.469142 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.469153 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.469192 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.469431 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.469432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.469563 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.469614 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.469616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.470389 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.470391 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.470851 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.470852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.471301 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.471302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.471380 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.471800 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.471804 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.472856 (+ 1052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.474491 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.474492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.474493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.474652 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.474862 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.474863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.474863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.474916 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.475177 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.475178 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.475214 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.475286 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.475378 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:44:43.475574 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.469160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.29.168.253:45711)
0808 14:44:43.469294 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.469298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.469320 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:44:43.469336 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.469337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.469348 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.469432 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.469690 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.470305 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.470924 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.471218 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.471300 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.472935 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.472943 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.472943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.472950 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.474411 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.474742 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.474744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.474744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.474796 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.474980 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.474981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.474982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.475107 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.475196 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.475315 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.475431 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260808 14:44:43.476039 30854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:43.476331 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.476219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33088)
0808 14:44:43.476255 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.476309 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 14:44:43.476444 30782 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
I20260808 14:44:43.476773 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.476689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33096)
0808 14:44:43.476732 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.476754 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:44:43.476873 30854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:42041: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab.
Entry for principal kudu/127.29.168.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab.
I20260808 14:44:43.483234 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:42041
--webserver_interface=127.29.168.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab
--principal=kudu/127.29.168.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:38817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:39559,127.29.168.253:45711,127.29.168.252:42041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:44:43.523702 30747 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } attempt: 3
I20260808 14:44:43.526057 30854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } attempt: 1
I20260808 14:44:43.526418 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.526306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33106)
0808 14:44:43.526358 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.526392 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:44:43.526829 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.526706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33120)
0808 14:44:43.526760 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.526786 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 14:44:43.527019 30854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:42041: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:43.530733 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.524209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40362 (local address 127.29.168.253:45711)
0808 14:44:43.524270 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.524272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.524282 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:43.524341 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.524342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.524357 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.524429 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.524749 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.525238 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.525943 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.526229 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.526311 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.528445 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.528446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.528447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.528454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.529688 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.530032 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.530034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.530034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.530102 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.530276 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.530277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.530277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.530383 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.530447 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.530588 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.530656 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:44:43.530740 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.524096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40362)
0808 14:44:43.524173 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.524187 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.524268 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.524446 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.524447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.524610 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.524672 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.524674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.525320 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.525321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.525866 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.525867 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.526327 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.526328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.526419 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.527021 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.527026 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.528364 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.529775 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.529776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.529777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.529964 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.530161 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.530162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.530162 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.530219 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.530449 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.530451 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.530492 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.530565 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.530656 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 14:44:43.531359 30747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:43.531694 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.531564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33124)
0808 14:44:43.531606 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.531633 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:44:43.531955 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.531896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33132)
0808 14:44:43.531924 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.531943 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 14:44:43.532045 30747 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:42041: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
W20260808 14:44:43.562551 30863 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:44:43.562726 30863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:43.562741 30863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:43.562777 30863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:44:43.563177 30747 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } attempt: 1
I20260808 14:44:43.563548 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.563436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33138)
0808 14:44:43.563499 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.563525 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:44:43.563879 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.563793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33150)
0808 14:44:43.563833 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.563857 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:44:43.563993 30747 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:42041: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
W20260808 14:44:43.564124 30863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:43.564164 30863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:43.564177 30863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:43.564213 30863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:43.564237 30863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:43.565735 30863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:38817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:39559,127.29.168.253:45711,127.29.168.252:42041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab
--principal=kudu/127.29.168.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:42041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.168.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:43.565949 30863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:43.566159 30863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:43.570703 30869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:43.570719 30873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:43.570721 30875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:43.570741 30863 server_base.cc:1034] running on GCE node
I20260808 14:44:43.571077 30863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:43.571406 30863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:43.572559 30863 hybrid_clock.cc:648] HybridClock initialized: now 1786200283572546 us; error 39 us; skew 500 ppm
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:43.574862 30863 init.cc:377] Logged in from keytab as kudu/127.29.168.252@KRBTEST.COM (short username kudu)
I20260808 14:44:43.575313 30863 webserver.cc:460] Webserver started at http://127.29.168.252:42925/ using document root <none> and password file <none>
I20260808 14:44:43.575547 30863 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:43.575623 30863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:43.575798 30863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:43.576769 30863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data/instance:
uuid: "efb445c097e145e58d4e3e94b4c4d7f3"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "1ff980f3e57cad03043a70e01968ed45"
server_key_iv: "6a6939fe197f171db8e19e86591987ac"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.577111 30863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal/instance:
uuid: "efb445c097e145e58d4e3e94b4c4d7f3"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "1ff980f3e57cad03043a70e01968ed45"
server_key_iv: "6a6939fe197f171db8e19e86591987ac"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.578370 30863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:43.579005 30882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:43.579149 30863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:43.579231 30863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal
uuid: "efb445c097e145e58d4e3e94b4c4d7f3"
format_stamp: "Formatted at 2026-08-08 14:44:43 on dist-test-slave-mjjr"
server_key: "1ff980f3e57cad03043a70e01968ed45"
server_key_iv: "6a6939fe197f171db8e19e86591987ac"
server_key_version: "encryptionkey@0"
I20260808 14:44:43.579314 30863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:43.594851 30863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:43.595175 30854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } attempt: 2
I20260808 14:44:43.595526 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.595412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33154)
0808 14:44:43.595470 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.595502 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:44:43.595846 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.595758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33164)
0808 14:44:43.595799 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.595826 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:44:43.595961 30854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:42041: Network error: Client connection negotiation failed: client connection to 127.29.168.252:42041: connect: Connection refused (error 111)
I20260808 14:44:43.596940 30863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:43.597087 30863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:43.600741 30863 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.252:42041
I20260808 14:44:43.600785 30959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.252:42041 every 8 connection(s)
I20260808 14:44:43.601073 30863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
I20260808 14:44:43.601892 30961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:43.603236 30961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:43.607740 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 30863
I20260808 14:44:43.607868 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200015623817-30371-0/minicluster-data/master-2/wal/instance
I20260808 14:44:43.608057 30371 external_mini_cluster.cc:1428] Setting key 35d3aad9cf5687292e105aca3342c76f
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:43.611989 30751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.603820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45044 (local address 127.29.168.254:39559)
0808 14:44:43.603906 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.603908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.604074 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:44:43.604571 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.604573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.604586 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.604638 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.605205 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.605696 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.606641 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.606828 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.606899 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.609220 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.609221 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.609222 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.609228 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.610681 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.611092 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.611093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.611093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.611142 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.611371 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.611371 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.611372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.611461 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.611507 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.611826 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.611904 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:44:43.612056 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.603789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:39559 (local address 127.0.0.1:45044)
0808 14:44:43.603970 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.604005 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.604458 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.604700 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.604704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.604940 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.605113 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.605117 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.605788 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.605789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.606527 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.606529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.606914 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.606915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.607031 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.607467 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.607475 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.609141 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.610743 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.610750 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.610751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.611025 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.611194 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.611195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.611195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.611314 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.611518 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.611524 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.611701 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.611790 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.611901 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260808 14:44:43.612632 30961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:43.617352 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.608421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33172 (local address 127.29.168.252:42041)
0808 14:44:43.608587 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.608591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.608664 (+ 73us) server_negotiation.cc:407] Connection header received
0808 14:44:43.608735 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.608738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.608760 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.608865 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.609585 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.610600 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.611562 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.611974 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.612088 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.614232 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.614240 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.614240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.614246 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.616146 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.616513 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.616528 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.616529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.616593 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.616812 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.616813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.616814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.616996 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.617154 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.617235 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.617291 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
I20260808 14:44:43.619287 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.612889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:45711 (local address 127.0.0.1:40378)
0808 14:44:43.612936 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.612948 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.612990 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.613106 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.613107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.613238 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.613286 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.613287 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.613809 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.613810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.614369 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.614372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.614904 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.614905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.614978 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.615327 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.615331 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.616660 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.618305 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.618306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.618307 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.618464 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.618668 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.618669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.618670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.618729 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.618974 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.618974 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.619012 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.619115 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.619199 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:44:43.619292 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.612933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40378 (local address 127.29.168.253:45711)
0808 14:44:43.612970 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.612972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.612980 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:43.613052 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.613053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.613060 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.613099 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.613351 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.613732 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.614494 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.614827 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.614886 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.616731 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.616732 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.616732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.616739 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.618235 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.618530 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.618532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.618532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.618607 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.618790 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.618791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.618791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.618903 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.618969 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.619140 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.619210 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:43.619946 30961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:44:43.624835 30751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.618112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45050 (local address 127.29.168.254:39559)
0808 14:44:43.618163 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.618165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.618173 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:43.618191 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.618192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.618200 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.618244 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.618668 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.619121 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.620057 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.620222 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.620301 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.622346 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.622347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.622347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.622352 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.623590 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.624013 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.624014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.624014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.624061 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.624245 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.624246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.624246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.624368 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.624560 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.624642 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.624727 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:44:43.626896 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.620432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33188)
0808 14:44:43.620521 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.620530 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.620574 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.620719 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.620720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.620869 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.620903 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.620904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.621462 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.621463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.621943 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.621945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.622279 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.622280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.622343 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.622928 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.622933 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.624174 (+ 1241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.625912 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.625913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.625913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.626070 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.626250 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.626251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.626252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.626299 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.626582 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.626583 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.626619 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.626691 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.626783 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 14:44:43.626916 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.620485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33188 (local address 127.29.168.252:42041)
0808 14:44:43.620519 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.620521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.620561 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:44:43.620644 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.620645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.620651 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.620692 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.620983 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.621395 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.622047 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.622210 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.622252 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.624257 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.624258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.624258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.624264 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.625825 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.626143 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.626144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.626144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.626188 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.626391 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.626392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.626392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.626496 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.626588 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.626723 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.626831 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":18}
I20260808 14:44:43.628494 30961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: Bootstrap starting.
I20260808 14:44:43.629527 30961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: Neither blocks nor log segments found. Creating new log.
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:43.629810 30961 log.cc:824] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:43.630460 30961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: No bootstrap required, opened a new log
I20260808 14:44:43.631940 30961 raft_consensus.cc:348] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.632061 30961 raft_consensus.cc:729] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb445c097e145e58d4e3e94b4c4d7f3, State: Initialized, Role: FOLLOWER
I20260808 14:44:43.632149 30961 consensus_queue.cc:260] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.632403 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.632452 30961 sys_catalog.cc:564] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:43.632498 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.632761 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.625724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40390 (local address 127.29.168.253:45711)
0808 14:44:43.625777 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.625779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.625787 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:43.625807 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.625808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.625815 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.625869 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.626278 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.626743 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.627582 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.627831 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.627892 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.630149 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.630150 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.630150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.630157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.631420 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.631804 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.631805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.631806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.631861 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.632098 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.632098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.632099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.632209 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.632376 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.632624 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.632687 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:44:43.634057 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 14:44:43.634265 30984 catalog_manager.cc:1558] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:43.634313 30984 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:43.635247 30711 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6433d81b082c4751af12a3fd0afd37f6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45050
I20260808 14:44:43.634518 30863 master_runner.cc:186] Error getting master registration for 127.29.168.254:39559: OK, instance_id { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" instance_seqno: 1786200283298970 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:44:43.636659 30863 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:44:43.639108 30747 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } attempt: 2
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:44:43.646027 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.639351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33200)
0808 14:44:43.639397 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.639406 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.639438 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.639565 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.639565 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.639765 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.639800 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.639802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.640578 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.640579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.641314 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.641317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.641728 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.641729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.641788 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.642153 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.642159 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.643366 (+ 1207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.645034 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.645035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.645036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.645198 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.645409 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.645410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.645411 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.645469 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.645733 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.645734 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.645773 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.645863 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.645946 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:44:43.646024 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.639421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33200 (local address 127.29.168.252:42041)
0808 14:44:43.639479 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.639480 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.639487 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:44:43.639503 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.639504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.639510 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.639561 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.639872 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.640501 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.641396 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.641662 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.641712 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.643445 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.643446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.643447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.643453 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.644941 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.645278 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.645279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.645279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.645331 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.645546 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.645547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.645547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.645673 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.645739 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.645887 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.645948 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:44:43.647830 30747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6: Bootstrap starting.
I20260808 14:44:43.648531 30747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:43.648813 30747 log.cc:824] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:43.649503 30747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6: No bootstrap required, opened a new log
I20260808 14:44:43.650449 30747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.650568 30747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6433d81b082c4751af12a3fd0afd37f6, State: Initialized, Role: FOLLOWER
I20260808 14:44:43.650653 30747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.650929 30994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.650975 30747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:43.651058 30994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.651065 30711 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:44:43.651222 30711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:43.652051 30711 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.652275 30711 leader_election.cc:288] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [CANDIDATE]: Term 1 election: Requested vote from peers 72a2f587773542cbb449d136cdf4fa91 (127.29.168.253:45711), efb445c097e145e58d4e3e94b4c4d7f3 (127.29.168.252:42041)
I20260808 14:44:43.653218 30920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6433d81b082c4751af12a3fd0afd37f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "efb445c097e145e58d4e3e94b4c4d7f3"
I20260808 14:44:43.653345 30920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:44:43.653671 31010 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:43.653713 31010 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:43.654253 30920 raft_consensus.cc:2454] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6433d81b082c4751af12a3fd0afd37f6 in term 1.
I20260808 14:44:43.654615 30678 leader_election.cc:302] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6433d81b082c4751af12a3fd0afd37f6, efb445c097e145e58d4e3e94b4c4d7f3; no voters:
I20260808 14:44:43.654731 30994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:43.654861 30994 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [term 1 LEADER]: Becoming Leader. State: Replica: 6433d81b082c4751af12a3fd0afd37f6, State: Running, Role: LEADER
I20260808 14:44:43.654934 30994 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.655365 31016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6433d81b082c4751af12a3fd0afd37f6. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.655550 31016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:43.653618 30654 master_runner.cc:186] Error getting master registration for 127.29.168.253:45711: OK, instance_id { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" instance_seqno: 1786200283454595 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:44:43.656370 30654 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:44:43.663954 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.656865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40400 (local address 127.29.168.253:45711)
0808 14:44:43.656899 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.656900 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.656960 (+ 60us) server_negotiation.cc:407] Connection header received
0808 14:44:43.657039 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.657040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.657048 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.657073 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.657722 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.658367 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.659381 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.659721 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.659770 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.661217 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.661218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.661219 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.661225 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.662828 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.663207 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.663208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.663208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.663256 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.663422 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.663423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.663423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.663521 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.663578 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.663783 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.663870 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:43.666833 30751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.656617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.29.168.254:39559)
0808 14:44:43.656655 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.656657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.656923 (+ 266us) server_negotiation.cc:407] Connection header received
0808 14:44:43.656943 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.656944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.656953 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.657011 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.658053 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.658682 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.660198 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.660469 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.660509 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.662555 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.662556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.662556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.662575 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.664237 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.665163 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.665165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.665165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.665221 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.665526 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.665527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.665528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.665656 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.666317 (+ 661us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.666673 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.666749 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:44:43.667780 31020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:43.667987 31020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:43.670393 30920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [term 1 FOLLOWER]: Refusing update from remote peer 6433d81b082c4751af12a3fd0afd37f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:43.670670 31016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:43.671854 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6433d81b082c4751af12a3fd0afd37f6. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.671929 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.672319 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.657010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33216 (local address 127.29.168.252:42041)
0808 14:44:43.657038 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.657039 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.664561 (+ 7522us) server_negotiation.cc:407] Connection header received
0808 14:44:43.664649 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.664650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.664659 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.664686 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.665308 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.666001 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.666979 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.667269 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.667306 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.668781 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.668783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.668783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.668789 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.670399 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.671283 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.671284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.671284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.671347 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.671680 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.671681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.671681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.671791 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.671864 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.672182 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.672244 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 14:44:43.684793 30994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.684885 30994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:43.684998 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.685084 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.685317 31026 mvcc.cc:205] Tried to move back new op lower bound from 7316276361910734848 to 7316276361851215872. Current Snapshot: MvccSnapshot[applied={T|T < 7316276361910734848}]
I20260808 14:44:43.685514 31025 mvcc.cc:205] Tried to move back new op lower bound from 7316276361910734848 to 7316276361851215872. Current Snapshot: MvccSnapshot[applied={T|T < 7316276361910734848}]
I20260808 14:44:43.685891 31020 catalog_manager.cc:1347] Generated new cluster ID: 340c5583920d4ae189e2fdbc95b7c909
I20260808 14:44:43.685931 31020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:43.691306 30854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } attempt: 3
Aug 08 14:44:43 dist-test-slave-mjjr krb5kdc[30635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200283, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:44:43.699147 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.691531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:42041 (local address 127.0.0.1:33226)
0808 14:44:43.691607 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:43.691617 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:43.691904 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:43.692070 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:43.692071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:43.692234 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:43.692272 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.692274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.693073 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.693074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.693843 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:43.693846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.694325 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.694326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:43.694387 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.694833 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:43.694838 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:43.696312 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:43.698051 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.698052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.698053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.698250 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.698490 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:43.698491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:43.698491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:43.698555 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:43.698860 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:43.698861 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:43.698909 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:44:43.698964 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:44:43.699046 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:44:43.700063 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:43.691773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33226 (local address 127.29.168.252:42041)
0808 14:44:43.691850 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.691851 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.691859 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:43.691973 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.691974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.691983 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.692030 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.692345 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.692989 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.693936 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:43.694221 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:43.694279 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:43.696396 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:43.696398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:43.696398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:43.696404 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:43.697944 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.698332 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.698333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.698333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.698415 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:43.698640 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:43.698641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:43.698641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:43.698769 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:43.698822 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:43.699894 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0808 14:44:43.699971 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:44:43.701416 30854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: Bootstrap starting.
I20260808 14:44:43.702085 30854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:43.702401 30854 log.cc:824] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:43.703260 30854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: No bootstrap required, opened a new log
I20260808 14:44:43.705202 30854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.705324 30854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a2f587773542cbb449d136cdf4fa91, State: Initialized, Role: FOLLOWER
I20260808 14:44:43.705394 30854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } }
I20260808 14:44:43.705698 30854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:43.705785 30817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6433d81b082c4751af12a3fd0afd37f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "72a2f587773542cbb449d136cdf4fa91"
I20260808 14:44:43.705901 30817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:43.706717 30817 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6433d81b082c4751af12a3fd0afd37f6 in term 1.
I20260808 14:44:43.707018 30815 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [term 1 FOLLOWER]: Refusing update from remote peer 6433d81b082c4751af12a3fd0afd37f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:43.707706 31016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:43.710999 31052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.711083 31052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.711127 31052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6433d81b082c4751af12a3fd0afd37f6. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.711176 31052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.711206 31052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.711247 31052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:43.712886 31050 mvcc.cc:205] Tried to move back new op lower bound from 7316276361910734848 to 7316276361851215872. Current Snapshot: MvccSnapshot[applied={T|T < 7316276361910734848}]
I20260808 14:44:43.713622 31048 catalog_manager.cc:1259] Loaded cluster ID: 340c5583920d4ae189e2fdbc95b7c909
I20260808 14:44:43.715705 31048 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: loading cluster ID for follower catalog manager: success
W20260808 14:44:43.715880 31048 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260808 14:44:43.715970 31048 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:43.716414 31016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6433d81b082c4751af12a3fd0afd37f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6433d81b082c4751af12a3fd0afd37f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 39559 } } peers { permanent_uuid: "72a2f587773542cbb449d136cdf4fa91" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 45711 } } peers { permanent_uuid: "efb445c097e145e58d4e3e94b4c4d7f3" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 42041 } } }
I20260808 14:44:43.716488 31016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:43.717547 31020 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:43.718261 31020 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:43.723521 31020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6433d81b082c4751af12a3fd0afd37f6: Generated new TSK 0
I20260808 14:44:43.723721 31020 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:44:43.753162 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.751474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40408 (local address 127.29.168.253:45711)
0808 14:44:43.751515 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.751517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.752519 (+ 1002us) server_negotiation.cc:407] Connection header received
0808 14:44:43.752616 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.752618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.752629 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.752657 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.753101 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40408: BlockingRecv error: recv got EOF from 127.0.0.1:40408 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 14:44:43.754016 30968 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.751856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33232 (local address 127.29.168.252:42041)
0808 14:44:43.751913 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.751915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.753528 (+ 1613us) server_negotiation.cc:407] Connection header received
0808 14:44:43.753612 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.753612 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.753622 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.753647 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.753963 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33232: BlockingRecv error: recv got EOF from 127.0.0.1:33232 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 14:44:43.754815 30751 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.752144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45074 (local address 127.29.168.254:39559)
0808 14:44:43.752183 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.752185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.754339 (+ 2154us) server_negotiation.cc:407] Connection header received
0808 14:44:43.754443 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.754443 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.754454 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.754482 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.754760 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45074: BlockingRecv error: recv got EOF from 127.0.0.1:45074 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:44:43.757205 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.756445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.29.168.253:45711)
0808 14:44:43.756474 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.756476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.756690 (+ 214us) server_negotiation.cc:407] Connection header received
0808 14:44:43.756779 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.756780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.756795 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.756820 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.757144 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40418: BlockingRecv error: recv got EOF from 127.0.0.1:40418 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260808 14:44:43.760242 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.759470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40424 (local address 127.29.168.253:45711)
0808 14:44:43.759501 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.759503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.759772 (+ 269us) server_negotiation.cc:407] Connection header received
0808 14:44:43.759887 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.759888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.759897 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.759924 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.760207 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40424: BlockingRecv error: recv got EOF from 127.0.0.1:40424 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:44:43.764170 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.763373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40432 (local address 127.29.168.253:45711)
0808 14:44:43.763422 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.763423 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.763639 (+ 216us) server_negotiation.cc:407] Connection header received
0808 14:44:43.763766 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.763767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.763777 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.763805 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.764134 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40432: BlockingRecv error: recv got EOF from 127.0.0.1:40432 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 14:44:43.769979 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.769256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40444 (local address 127.29.168.253:45711)
0808 14:44:43.769287 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.769288 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.769510 (+ 222us) server_negotiation.cc:407] Connection header received
0808 14:44:43.769597 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.769598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.769607 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.769633 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.769943 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40444: BlockingRecv error: recv got EOF from 127.0.0.1:40444 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:44:43.780051 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.779137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40450 (local address 127.29.168.253:45711)
0808 14:44:43.779183 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.779185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.779424 (+ 239us) server_negotiation.cc:407] Connection header received
0808 14:44:43.779520 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.779522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.779532 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.779587 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.779973 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40450: BlockingRecv error: recv got EOF from 127.0.0.1:40450 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:44:43.798712 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.797584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40460 (local address 127.29.168.253:45711)
0808 14:44:43.797619 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.797621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.797890 (+ 269us) server_negotiation.cc:407] Connection header received
0808 14:44:43.797994 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.797995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.798006 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.798234 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.798662 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40460: BlockingRecv error: recv got EOF from 127.0.0.1:40460 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 14:44:43.832864 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.832105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40470 (local address 127.29.168.253:45711)
0808 14:44:43.832161 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.832163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.832251 (+ 88us) server_negotiation.cc:407] Connection header received
0808 14:44:43.832315 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.832316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.832329 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.832432 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.832799 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40470: BlockingRecv error: recv got EOF from 127.0.0.1:40470 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 14:44:43.898857 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:43.898031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40482 (local address 127.29.168.253:45711)
0808 14:44:43.898115 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:43.898117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:43.898239 (+ 122us) server_negotiation.cc:407] Connection header received
0808 14:44:43.898284 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:43.898285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:43.898295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:43.898344 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:43.898792 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40482: BlockingRecv error: recv got EOF from 127.0.0.1:40482 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 14:44:44.028723 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:44.028003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40484 (local address 127.29.168.253:45711)
0808 14:44:44.028089 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.028091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.028151 (+ 60us) server_negotiation.cc:407] Connection header received
0808 14:44:44.028217 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.028218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.028228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.028290 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:44.028668 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40484: BlockingRecv error: recv got EOF from 127.0.0.1:40484 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 14:44:44.286451 30860 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:44.285833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40486 (local address 127.29.168.253:45711)
0808 14:44:44.285916 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.285918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.285926 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:44.285970 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.285971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.285980 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.286038 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:44.286374 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40486: BlockingRecv error: recv got EOF from 127.0.0.1:40486 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:44:44.634714 30984 catalog_manager.cc:1259] Loaded cluster ID: 340c5583920d4ae189e2fdbc95b7c909
I20260808 14:44:44.634780 30984 catalog_manager.cc:1552] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: loading cluster ID for follower catalog manager: success
I20260808 14:44:44.635536 30984 catalog_manager.cc:1574] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: acquiring CA information for follower catalog manager: success
I20260808 14:44:44.635818 30984 catalog_manager.cc:1602] T 00000000000000000000000000000000 P efb445c097e145e58d4e3e94b4c4d7f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:44:44.717063 31048 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: acquiring CA information for follower catalog manager: success
I20260808 14:44:44.717407 31048 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72a2f587773542cbb449d136cdf4fa91: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:44:44.801932 31148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:44.799587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40490 (local address 127.29.168.253:45711)
0808 14:44:44.799738 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.799740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.799750 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:44:44.799776 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.799777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.799825 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.799906 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:44.800036 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.800502 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.801238 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.801421 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.801472 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:44.801603 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:44.801724 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:44.801779 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:44.801812 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 14:44:44.801828 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260808 14:44:44.806006 31158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:44.803788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.29.168.252:42041)
0808 14:44:44.803900 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.803902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.803932 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:44:44.803973 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.803974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.804009 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.804064 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:44.804161 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.804630 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.805262 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.805452 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.805518 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:44.805691 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:44.805790 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:44.805848 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:44.805885 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 14:44:44.805903 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":68,"threads_started":1}
I20260808 14:44:44.810346 31148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:44.807584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40504 (local address 127.29.168.253:45711)
0808 14:44:44.807620 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.807622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.807826 (+ 204us) server_negotiation.cc:407] Connection header received
0808 14:44:44.807851 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.807852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.807860 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.807912 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:44.808042 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.808676 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.809536 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.809725 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.809826 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:44.809988 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:44.810017 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:44.810056 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:44.810255 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:44:44.810276 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:44:44.810714 31158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:44.807864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33244 (local address 127.29.168.252:42041)
0808 14:44:44.807898 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.807899 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.807983 (+ 84us) server_negotiation.cc:407] Connection header received
0808 14:44:44.808078 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.808079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.808091 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.808136 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:44.808273 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.808670 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.809891 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.810192 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.810271 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:44.810420 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:44.810451 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:44.810483 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:44.810616 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:44:44.810641 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:44.810881 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:44.807554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.29.168.254:39559)
0808 14:44:44.807676 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:44.807690 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:44.807814 (+ 124us) server_negotiation.cc:407] Connection header received
0808 14:44:44.807863 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:44.807864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:44.807913 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:44.807979 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:44.808116 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.808795 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.809877 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:44.810101 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:44.810188 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:44.810384 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:44.810494 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:44.810552 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:44.810741 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:44:44.810788 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260808 14:44:44.812626 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30654
I20260808 14:44:44.831457 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30757
I20260808 14:44:44.841917 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 30863
2026-08-08T14:44:44Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2957 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:44 dist-test-slave-mjjr krb5kdc[31175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:44 dist-test-slave-mjjr krb5kdc[31175](info): set up 2 sockets
Aug 08 14:44:44 dist-test-slave-mjjr krb5kdc[31175](info): commencing operation
krb5kdc: starting...
W20260808 14:44:46.008950 30371 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/test-user.keytab.
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.168.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
Entry for principal kudu/127.29.168.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab.
I20260808 14:44:46.136354 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37755
--webserver_interface=127.29.168.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37755,127.29.168.253:39851,127.29.168.252:37015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:46.214326 31193 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:44:46.214557 31193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:46.214593 31193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:46.214632 31193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:46.215787 31193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:46.215850 31193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:46.215873 31193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:46.215893 31193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:46.215921 31193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:46.217362 31193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37755,127.29.168.253:39851,127.29.168.252:37015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.254.keytab
--principal=kudu/127.29.168.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.254:37755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.168.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:46.217623 31193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:46.217828 31193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:46.222523 31198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:46.222581 31205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:46.222734 31193 server_base.cc:1034] running on GCE node
W20260808 14:44:46.222741 31200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:46.223013 31193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:46.223306 31193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:46.224462 31193 hybrid_clock.cc:648] HybridClock initialized: now 1786200286224452 us; error 38 us; skew 500 ppm
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:46.226794 31193 init.cc:377] Logged in from keytab as kudu/127.29.168.254@KRBTEST.COM (short username kudu)
I20260808 14:44:46.227238 31193 webserver.cc:460] Webserver started at http://127.29.168.254:39857/ using document root <none> and password file <none>
I20260808 14:44:46.227480 31193 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:46.227545 31193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:46.227718 31193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:46.228701 31193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data/instance:
uuid: "e2ece2a8bd85471b8019db206619a8f6"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "9b2fe369e52fef0b793da49f5450035f"
server_key_iv: "e4eb362922bd542b29b469b51e8ebd18"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.229040 31193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal/instance:
uuid: "e2ece2a8bd85471b8019db206619a8f6"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "9b2fe369e52fef0b793da49f5450035f"
server_key_iv: "e4eb362922bd542b29b469b51e8ebd18"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.230270 31193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:44:46.230937 31214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:46.231114 31193 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:46.231200 31193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal
uuid: "e2ece2a8bd85471b8019db206619a8f6"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "9b2fe369e52fef0b793da49f5450035f"
server_key_iv: "e4eb362922bd542b29b469b51e8ebd18"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.231274 31193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:46.259745 31193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:46.261428 31193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:46.261570 31193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:46.265626 31193 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.254:37755
I20260808 14:44:46.265662 31287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.254:37755 every 8 connection(s)
I20260808 14:44:46.266005 31193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:46.266870 31291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:46.268414 31291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.271068 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31193
I20260808 14:44:46.271171 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-0/wal/instance
I20260808 14:44:46.271350 30371 external_mini_cluster.cc:1428] Setting key b105c943cf05c52153178eb57e7a2975
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:46.277498 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.269055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51000 (local address 127.29.168.254:37755)
0808 14:44:46.269214 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.269218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.269276 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:44:46.269763 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.269764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.269779 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.269854 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.270309 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.271104 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.272064 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.272361 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.272497 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.274377 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.274384 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.274385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.274391 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.275992 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.276371 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.276374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.276374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.276449 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.276660 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.276661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.276661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.276851 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.276935 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.277111 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.277232 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260808 14:44:46.277498 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.269006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37755 (local address 127.0.0.1:51000)
0808 14:44:46.269169 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.269208 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.269650 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.269874 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.269876 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.270102 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.270239 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.270243 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.271199 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.271200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.271981 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.271983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.272461 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.272462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.272523 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.273007 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.273014 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.274291 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.276098 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.276104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.276106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.276291 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.276513 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.276514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.276515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.276599 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.276916 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.276921 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.276979 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.277077 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.277293 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":91,"thread_start_us":77,"threads_started":1}
I20260808 14:44:46.278191 31291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.278541 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.278421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40442)
0808 14:44:46.278470 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.278513 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:44:46.278710 31216 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
I20260808 14:44:46.279129 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.279039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40446)
0808 14:44:46.279080 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.279108 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
WARNING: no policy specified for kudu/127.29.168.253@KRBTEST.COM; defaulting to no policy
W20260808 14:44:46.279290 31291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:39851: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab.
Entry for principal kudu/127.29.168.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab.
I20260808 14:44:46.293993 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:39851
--webserver_interface=127.29.168.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab
--principal=kudu/127.29.168.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37755,127.29.168.253:39851,127.29.168.252:37015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:44:46.328482 31291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } attempt: 1
I20260808 14:44:46.329046 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.328869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40462)
0808 14:44:46.328962 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.329001 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 14:44:46.329444 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.329361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40472)
0808 14:44:46.329405 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.329428 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:44:46.329555 31291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:39851: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
W20260808 14:44:46.372963 31298 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:44:46.373143 31298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:46.373159 31298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:46.373178 31298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:46.374256 31298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:46.374292 31298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:46.374305 31298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:46.374346 31298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:46.374370 31298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:46.375895 31298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37755,127.29.168.253:39851,127.29.168.252:37015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.253.keytab
--principal=kudu/127.29.168.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.253:39851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.168.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:46.376157 31298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:46.376370 31298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:46.380781 31304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:46.380867 31305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:46.380795 31307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:46.381029 31298 server_base.cc:1034] running on GCE node
I20260808 14:44:46.381234 31298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:46.381493 31298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:46.382624 31298 hybrid_clock.cc:648] HybridClock initialized: now 1786200286382615 us; error 25 us; skew 500 ppm
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:46.385097 31298 init.cc:377] Logged in from keytab as kudu/127.29.168.253@KRBTEST.COM (short username kudu)
I20260808 14:44:46.385489 31298 webserver.cc:460] Webserver started at http://127.29.168.253:45063/ using document root <none> and password file <none>
I20260808 14:44:46.385716 31298 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:46.385780 31298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:46.385931 31298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:46.387121 31298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data/instance:
uuid: "6c844e858b6a41daaa781dbd44fdfb7b"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "1cbe209ddb4198b31921c109921fd1d9"
server_key_iv: "0e755e5e287ecf2808a8be79aa023205"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.387516 31298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal/instance:
uuid: "6c844e858b6a41daaa781dbd44fdfb7b"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "1cbe209ddb4198b31921c109921fd1d9"
server_key_iv: "0e755e5e287ecf2808a8be79aa023205"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.388849 31298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:44:46.389765 31319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:46.389972 31298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:46.390070 31298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal
uuid: "6c844e858b6a41daaa781dbd44fdfb7b"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "1cbe209ddb4198b31921c109921fd1d9"
server_key_iv: "0e755e5e287ecf2808a8be79aa023205"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.390136 31298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:46.397068 31298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:46.397701 31291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } attempt: 2
I20260808 14:44:46.398131 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.397974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40478)
0808 14:44:46.398039 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.398076 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:44:46.398612 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.398497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40488)
0808 14:44:46.398546 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.398578 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:44:46.398715 31291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.253:39851: Network error: Client connection negotiation failed: client connection to 127.29.168.253:39851: connect: Connection refused (error 111)
I20260808 14:44:46.399186 31298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:46.399295 31298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:46.403085 31298 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.253:39851
I20260808 14:44:46.403115 31395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.253:39851 every 8 connection(s)
I20260808 14:44:46.403437 31298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/data/info.pb
I20260808 14:44:46.404316 31396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:46.405841 31396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.408425 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31298
I20260808 14:44:46.408526 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-1/wal/instance
I20260808 14:44:46.408692 30371 external_mini_cluster.cc:1428] Setting key 36940ab7f16bb299330beb23b835fbf3
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:46.414897 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.406498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51008 (local address 127.29.168.254:37755)
0808 14:44:46.406551 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.406552 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.406763 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:44:46.407287 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.407288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.407300 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.407373 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.408025 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.408700 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.409688 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.410016 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.410086 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.412169 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.412171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.412171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.412179 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.413540 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.413946 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.413948 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.413948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.414012 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.414256 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.414257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.414257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.414379 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.414449 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.414723 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.414813 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:44:46.415084 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.406475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37755 (local address 127.0.0.1:51008)
0808 14:44:46.406654 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.406687 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.407189 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.407444 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.407447 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.407743 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.407929 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.407933 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.408830 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.408831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.409578 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.409580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.410107 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.410108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.410202 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.410666 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.410675 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.412069 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.413623 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.413630 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.413633 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.413871 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.414083 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.414084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.414085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.414191 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.414454 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.414461 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.414591 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.414689 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.414850 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":80,"threads_started":1}
I20260808 14:44:46.415599 31396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.168.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.168.252@KRBTEST.COM" created.
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:46.423295 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.415865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40490)
0808 14:44:46.415909 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.415918 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.415954 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.416212 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.416213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.416362 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.416420 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.416421 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.417233 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.417234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.417766 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.417768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.418287 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.418288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.418348 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.418714 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.418718 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.420544 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.422251 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.422252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.422252 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.422496 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.422683 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.422683 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.422684 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.422736 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.423078 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.423079 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.423114 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.423170 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.423237 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:44:46.423472 31403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.415948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40490 (local address 127.29.168.253:39851)
0808 14:44:46.416081 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.416084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.416099 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:44:46.416114 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.416115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.416124 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.416198 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.416499 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.417154 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.417851 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.418211 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.418286 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.420635 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.420644 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.420644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.420651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.422165 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.422574 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.422576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.422577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.422626 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.422822 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.422823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.422824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.423005 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.423092 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.423225 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.423322 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":90,"threads_started":1}
I20260808 14:44:46.424052 31396 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.424400 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.424263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49626)
0808 14:44:46.424316 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.424369 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:44:46.424558 31320 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
I20260808 14:44:46.425004 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.424896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49632)
0808 14:44:46.424943 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.424974 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:44:46.425246 31396 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:37015: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.168.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab.
Entry for principal kudu/127.29.168.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab.
I20260808 14:44:46.435588 30371 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskniu_ne/build/release/bin/kudu
/tmp/dist-test-taskniu_ne/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:37015
--webserver_interface=127.29.168.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab
--principal=kudu/127.29.168.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.168.212:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.168.254:37755,127.29.168.253:39851,127.29.168.252:37015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:44:46.474575 31396 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } attempt: 1
I20260808 14:44:46.475050 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.474925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49642)
0808 14:44:46.474988 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.475021 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:44:46.475365 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.475279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49646)
0808 14:44:46.475320 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.475343 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 14:44:46.475457 31396 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:37015: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
I20260808 14:44:46.489858 31291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } attempt: 3
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:46.497663 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.490153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40500)
0808 14:44:46.490199 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.490214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.490281 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.490433 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.490434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.490595 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.490661 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.490663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.491406 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.491408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.492021 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.492023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.492681 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.492683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.492809 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.493282 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.493286 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.494873 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.496675 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.496676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.496676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.496855 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.497079 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.497079 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.497080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.497134 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.497428 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.497429 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.497467 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.497525 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.497600 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:44:46.497792 31403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.490212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40500 (local address 127.29.168.253:39851)
0808 14:44:46.490271 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.490273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.490285 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:44:46.490350 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.490351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.490363 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.490427 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.490790 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.491316 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.492155 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.492586 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.492669 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.494963 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.494965 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.494965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.494972 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.496586 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.496930 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.496932 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.496932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.497001 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.497193 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.497193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.497194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.497355 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.497430 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.497572 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.497661 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:44:46.498201 31291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.498577 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.498469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49660)
0808 14:44:46.498520 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.498555 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:44:46.498966 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.498866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49662)
0808 14:44:46.498911 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.498942 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:44:46.499090 31291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:37015: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
W20260808 14:44:46.516165 31407 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:44:46.516337 31407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:46.516355 31407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:46.516403 31407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:46.517503 31407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:46.517541 31407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:46.517554 31407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:46.517602 31407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:46.517647 31407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:46.519047 31407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.168.212:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.168.254:37755,127.29.168.253:39851,127.29.168.252:37015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/krb5kdc/kudu_127.29.168.252.keytab
--principal=kudu/127.29.168.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.168.252:37015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.168.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:46.519248 31407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:46.519439 31407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:46.523907 31414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:46.523916 31412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:46.523927 31417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:46.524026 31407 server_base.cc:1034] running on GCE node
I20260808 14:44:46.524297 31407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:46.524583 31407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:46.525743 31407 hybrid_clock.cc:648] HybridClock initialized: now 1786200286525745 us; error 41 us; skew 500 ppm
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:46.528096 31407 init.cc:377] Logged in from keytab as kudu/127.29.168.252@KRBTEST.COM (short username kudu)
I20260808 14:44:46.528497 31407 webserver.cc:460] Webserver started at http://127.29.168.252:41585/ using document root <none> and password file <none>
I20260808 14:44:46.528702 31407 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:46.528764 31407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:46.528906 31407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:46.529855 31407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data/instance:
uuid: "f382f07db19a449cb1645fd6cea776c9"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "86801d90b7a492ad13d81bfde28859b9"
server_key_iv: "8ad0835570e41b16939c33f8ca0bf5d3"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.530181 31407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal/instance:
uuid: "f382f07db19a449cb1645fd6cea776c9"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "86801d90b7a492ad13d81bfde28859b9"
server_key_iv: "8ad0835570e41b16939c33f8ca0bf5d3"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.530239 31291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } attempt: 1
I20260808 14:44:46.530558 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.530467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49668)
0808 14:44:46.530512 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.530539 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:44:46.530812 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.530744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49680)
0808 14:44:46.530770 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.530790 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 14:44:46.530889 31291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:37015: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
I20260808 14:44:46.531683 31407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:44:46.532397 31426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:46.532569 31407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:46.532651 31407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data,/tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal
uuid: "f382f07db19a449cb1645fd6cea776c9"
format_stamp: "Formatted at 2026-08-08 14:44:46 on dist-test-slave-mjjr"
server_key: "86801d90b7a492ad13d81bfde28859b9"
server_key_iv: "8ad0835570e41b16939c33f8ca0bf5d3"
server_key_version: "encryptionkey@0"
I20260808 14:44:46.532716 31407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:46.542260 31407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:46.543603 31396 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } attempt: 2
I20260808 14:44:46.543913 31407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:46.543929 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.543825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49690)
0808 14:44:46.543875 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.543905 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:44:46.544039 31407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:46.544324 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.544253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49692)
0808 14:44:46.544288 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.544310 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 14:44:46.544485 31396 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.168.252:37015: Network error: Client connection negotiation failed: client connection to 127.29.168.252:37015: connect: Connection refused (error 111)
I20260808 14:44:46.547905 31407 rpc_server.cc:307] RPC server started. Bound to: 127.29.168.252:37015
I20260808 14:44:46.547935 31502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.168.252:37015 every 8 connection(s)
I20260808 14:44:46.548241 31407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/data/info.pb
I20260808 14:44:46.549085 31503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:46.550371 30371 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskniu_ne/build/release/bin/kudu as pid 31407
I20260808 14:44:46.550513 30371 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskniu_ne/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200015623817-30371-0/minicluster-data/master-2/wal/instance
I20260808 14:44:46.550406 31503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.550702 30371 external_mini_cluster.cc:1428] Setting key acaa37ba9d8eb88739f231d7c8a27393
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:44:46.559924 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.551369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51018 (local address 127.29.168.254:37755)
0808 14:44:46.551418 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.551420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.551562 (+ 142us) server_negotiation.cc:407] Connection header received
0808 14:44:46.551931 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.551932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.551942 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.551991 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.552718 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.553446 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.554550 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.554792 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.554860 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.556974 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.556975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.556975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.556980 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.558533 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.558937 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.558939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.558939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.558999 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.559259 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.559260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.559260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.559357 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.559409 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.559743 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.559834 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:44:46.560050 31508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.551339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.254:37755 (local address 127.0.0.1:51018)
0808 14:44:46.551461 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.551494 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.551838 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.552013 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.552015 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.552365 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.552606 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.552611 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.553519 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.553519 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.554468 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.554471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.554879 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.554880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.554974 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.555435 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.555444 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.556901 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.558605 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.558612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.558613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.558858 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.559070 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.559070 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.559071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.559176 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.559420 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.559427 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.559571 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.559720 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.559875 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":65,"threads_started":1}
I20260808 14:44:46.560534 31503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.560642 31506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.551141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49696 (local address 127.29.168.252:37015)
0808 14:44:46.551274 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.551296 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.551325 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:44:46.551829 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.551835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.551853 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.551960 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.552738 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.553770 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.554776 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.555117 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.555195 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.557556 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.557564 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.557565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.557571 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.559168 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.559518 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.559520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.559520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.559565 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.559780 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.559781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.559781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.559938 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.560419 (+ 481us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.560463 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.560532 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.254@KRBTEST.COM
I20260808 14:44:46.567878 31403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.560890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40502 (local address 127.29.168.253:39851)
0808 14:44:46.560940 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.560942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.560950 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:46.561009 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.561010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.561032 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.561091 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.561426 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.562168 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.563011 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.563306 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.563372 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.565288 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.565289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.565290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.565296 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.566734 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.567115 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.567116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.567116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.567178 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.567391 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.567392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.567392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.567491 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.567544 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.567749 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.567817 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:44:46.567948 31508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.560784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.253:39851 (local address 127.0.0.1:40502)
0808 14:44:46.560898 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.560908 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.560946 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.561165 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.561166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.561318 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.561351 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.561352 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.562238 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.562239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.562945 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.562947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.563378 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.563379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.563421 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.563833 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.563838 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.565207 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.566812 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.566813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.566814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.567044 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.567244 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.567245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.567246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.567324 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.567555 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.567556 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.567598 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.567723 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.567825 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 14:44:46.568382 31503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:44:46.569110 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.561387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51030 (local address 127.29.168.254:37755)
0808 14:44:46.561420 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.561422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.561503 (+ 81us) server_negotiation.cc:407] Connection header received
0808 14:44:46.561562 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.561563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.561571 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.561606 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.562123 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.562746 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.563580 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.563847 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.563927 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.566318 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.566320 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.566320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.566326 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.568036 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.568384 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.568384 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.568385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.568455 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.568642 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.568643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.568643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.568756 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.568932 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.568966 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.569030 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.252@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.168.253@KRBTEST.COM
I20260808 14:44:46.574963 31508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.568606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49710)
0808 14:44:46.569209 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.569235 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.569280 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.569416 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.569417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.569550 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.569610 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.569613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.570220 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.570221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.570654 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.570655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.571014 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.571015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.571059 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.571587 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.571591 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.572627 (+ 1036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.574047 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.574048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.574048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.574192 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.574368 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.574369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.574369 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.574425 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.574652 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.574653 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.574706 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.574764 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.574857 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590}
I20260808 14:44:46.575030 31506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.568636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49710 (local address 127.29.168.252:37015)
0808 14:44:46.568673 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.568675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.569326 (+ 651us) server_negotiation.cc:407] Connection header received
0808 14:44:46.569340 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.569341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.569359 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.569401 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.569686 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.570144 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.570724 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.570941 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.571014 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.572715 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.572716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.572716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.572722 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.573979 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.574264 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.574265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.574266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.574312 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.574484 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.574485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.574485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.574592 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.574677 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.574799 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.574913 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":17}
I20260808 14:44:46.576279 31403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.569740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40506 (local address 127.29.168.253:39851)
0808 14:44:46.569779 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.569780 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.569791 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:44:46.569813 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.569814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.569822 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.569864 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.570283 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.570685 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.571327 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.571492 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.571534 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.573743 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.573744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.573744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.573749 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.574992 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.575470 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.575471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.575471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.575532 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.575746 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.575747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.575747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.575859 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.576043 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.576081 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.576168 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:46.576504 31503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: Bootstrap starting.
I20260808 14:44:46.577555 31503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:46.577615 30371 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:44:46.577804 31503 log.cc:824] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:46.578545 31503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: No bootstrap required, opened a new log
I20260808 14:44:46.578612 31254 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e2ece2a8bd85471b8019db206619a8f6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51030
I20260808 14:44:46.579981 31503 raft_consensus.cc:348] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.580087 31503 raft_consensus.cc:729] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f382f07db19a449cb1645fd6cea776c9, State: Initialized, Role: FOLLOWER
I20260808 14:44:46.580165 31503 consensus_queue.cc:260] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.580472 31503 sys_catalog.cc:564] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:46.580467 31511 sys_catalog.cc:455] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.580598 31511 sys_catalog.cc:458] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:44:46.582314 31526 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:46.582432 31526 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:46.582340 31407 master_runner.cc:186] Error getting master registration for 127.29.168.254:37755: OK, instance_id { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" instance_seqno: 1786200286264398 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:44:46.584964 31407 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:44:46.606033 31291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } attempt: 2
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.254@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:44:46.612993 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.606286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49722)
0808 14:44:46.606384 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.606396 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.606444 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.606580 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.606581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.606751 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.606793 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.606794 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.607349 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.607350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.608181 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.608183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.608623 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.608624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.608680 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.609117 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.609122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.610497 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.612004 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.612005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.612006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.612178 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.612371 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.612372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.612372 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.612426 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.612689 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.612690 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.612731 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.612804 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.612905 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 14:44:46.612991 31506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.606415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49722 (local address 127.29.168.252:37015)
0808 14:44:46.606463 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.606474 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.606483 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:44:46.606508 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.606508 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.606516 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.606561 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.606853 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.607275 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.608268 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.608550 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.608617 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.610580 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.610581 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.610582 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.610589 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.611916 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.612246 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.612247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.612247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.612298 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.612491 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.612491 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.612492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.612615 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.612684 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.612841 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.612906 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:44:46.614683 31291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6: Bootstrap starting.
I20260808 14:44:46.615403 31291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:46.615737 31291 log.cc:824] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:46.616556 31291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6: No bootstrap required, opened a new log
I20260808 14:44:46.617827 31291 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.617951 31291 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ece2a8bd85471b8019db206619a8f6, State: Initialized, Role: FOLLOWER
I20260808 14:44:46.618028 31291 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.618304 31291 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:46.618266 31531 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.618377 31531 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:46.618448 31254 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:44:46.618503 31254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:46.619156 31254 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.619655 31463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2ece2a8bd85471b8019db206619a8f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f382f07db19a449cb1645fd6cea776c9"
I20260808 14:44:46.619793 31463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:46.620608 31463 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ece2a8bd85471b8019db206619a8f6 in term 1.
I20260808 14:44:46.620877 31215 leader_election.cc:302] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2ece2a8bd85471b8019db206619a8f6, f382f07db19a449cb1645fd6cea776c9; no voters:
I20260808 14:44:46.621023 31531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:46.621145 31531 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [term 1 LEADER]: Becoming Leader. State: Replica: e2ece2a8bd85471b8019db206619a8f6, State: Running, Role: LEADER
I20260808 14:44:46.621217 31531 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.620774 31254 leader_election.cc:288] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6c844e858b6a41daaa781dbd44fdfb7b (127.29.168.253:39851), f382f07db19a449cb1645fd6cea776c9 (127.29.168.252:37015)
I20260808 14:44:46.621603 31531 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2ece2a8bd85471b8019db206619a8f6. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.621671 31531 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: This master's current role is: LEADER
W20260808 14:44:46.621690 31546 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:46.621732 31546 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:46.622244 31552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:46.622431 31552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:46.622702 31193 master_runner.cc:186] Error getting master registration for 127.29.168.253:39851: OK, instance_id { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" instance_seqno: 1786200286402020 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:44:46.625118 31193 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:44:46.632108 31463 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [term 1 FOLLOWER]: Refusing update from remote peer e2ece2a8bd85471b8019db206619a8f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:46.632404 31403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.625247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40512 (local address 127.29.168.253:39851)
0808 14:44:46.625290 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.625292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.625300 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:46.625322 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.625323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.625331 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.625400 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.626124 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.626851 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.627912 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.628235 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.628274 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.629693 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.629694 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.629694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.629711 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.631155 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.631551 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.631553 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.631553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.631605 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.631850 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.631851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.631851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.631971 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.632037 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.632229 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.632303 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:44:46.632411 31531 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:46.634029 31511 sys_catalog.cc:455] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2ece2a8bd85471b8019db206619a8f6. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.634135 31511 sys_catalog.cc:458] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:46.635598 31396 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } attempt: 3
I20260808 14:44:46.637034 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.625194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51038 (local address 127.29.168.254:37755)
0808 14:44:46.625237 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.625239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.625260 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:44:46.625279 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.625280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.625289 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.625342 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.626438 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.627140 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.628975 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.629262 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.629302 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.632014 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.632015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.632015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.632022 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.634231 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.635373 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.635374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.635375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.635446 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.635841 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.635843 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.635843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.636454 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.636538 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.636877 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.636954 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:44:46.638088 31547 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.638177 31547 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:46.638795 31511 sys_catalog.cc:455] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.638893 31511 sys_catalog.cc:458] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:46.640821 31506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.623704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49724 (local address 127.29.168.252:37015)
0808 14:44:46.623741 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.623743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.632712 (+ 8969us) server_negotiation.cc:407] Connection header received
0808 14:44:46.632803 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.632804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.632813 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.632841 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.633379 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.634132 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.635256 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.635556 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.635596 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.637256 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.637257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.637257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.637264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.639584 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.640002 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.640003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.640003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.640055 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.640258 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.640259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.640259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.640387 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.640453 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.640664 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.640738 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:44:46.641428 31565 mvcc.cc:205] Tried to move back new op lower bound from 7316276374011703296 to 7316276374001139712. Current Snapshot: MvccSnapshot[applied={T|T < 7316276374011703296}]
Aug 08 14:44:46 dist-test-slave-mjjr krb5kdc[31175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200286, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.168.253@KRBTEST.COM for kudu/127.29.168.252@KRBTEST.COM
I20260808 14:44:46.648018 31552 catalog_manager.cc:1347] Generated new cluster ID: c7f1b53c82594264bb3265abacf801c3
I20260808 14:44:46.648072 31552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:44:46.649552 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.635827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.168.252:37015 (local address 127.0.0.1:49738)
0808 14:44:46.635938 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:46.635965 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:46.636003 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:46.638897 (+ 2894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:46.638898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:46.639064 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:46.639101 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.639102 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.640599 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.640600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.641461 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:46.641464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.642795 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.642796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:46.642858 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.643259 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:46.643263 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:46.645522 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:46.648339 (+ 2817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.648340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.648341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.648562 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.648847 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:46.648847 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:46.648848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:46.648913 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:46.649267 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:46.649267 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:46.649320 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 14:44:46.649365 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:44:46.649461 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 14:44:46.650064 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:46.636193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49738 (local address 127.29.168.252:37015)
0808 14:44:46.638454 (+ 2261us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.638456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.638464 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:46.638505 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.638506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.638525 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.639273 (+ 748us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.639329 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.640463 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.642036 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:46.642661 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:46.645613 (+ 2952us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:46.645683 (+ 70us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:46.645683 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:46.645684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:46.645689 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:46.648217 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.648655 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.648656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.648657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.648759 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:46.648995 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:46.648995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:46.648995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:46.649175 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:46.649739 (+ 564us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:46.649803 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:44:46.649922 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2238,"thread_start_us":86,"threads_started":1}
I20260808 14:44:46.651538 31396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: Bootstrap starting.
I20260808 14:44:46.652223 31396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:46.652530 31396 log.cc:824] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:46.653684 31396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: No bootstrap required, opened a new log
I20260808 14:44:46.655617 31396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.656016 31396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c844e858b6a41daaa781dbd44fdfb7b, State: Initialized, Role: FOLLOWER
I20260808 14:44:46.656142 31396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } }
I20260808 14:44:46.656591 31359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2ece2a8bd85471b8019db206619a8f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6c844e858b6a41daaa781dbd44fdfb7b"
I20260808 14:44:46.656683 31358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:46.656554 31396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:46.657413 31358 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [term 1 FOLLOWER]: Refusing update from remote peer e2ece2a8bd85471b8019db206619a8f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:44:46.657661 31531 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:44:46.658545 31359 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ece2a8bd85471b8019db206619a8f6 in term 1.
I20260808 14:44:46.662191 31571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.662308 31571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:46.662386 31571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2ece2a8bd85471b8019db206619a8f6. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.662479 31571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:46.662537 31571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.662624 31571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:44:46.663394 31552 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:46.664080 31552 catalog_manager.cc:1504] Loading token signing keys...
W20260808 14:44:46.668195 31591 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:44:46.668273 31591 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:44:46.668665 31552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6: Generated new TSK 0
I20260808 14:44:46.668816 31552 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:44:46.669463 31593 mvcc.cc:205] Tried to move back new op lower bound from 7316276374011703296 to 7316276374001139712. Current Snapshot: MvccSnapshot[applied={T|T < 7316276374011703296}]
I20260808 14:44:46.670182 31547 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2ece2a8bd85471b8019db206619a8f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2ece2a8bd85471b8019db206619a8f6" member_type: VOTER last_known_addr { host: "127.29.168.254" port: 37755 } } peers { permanent_uuid: "6c844e858b6a41daaa781dbd44fdfb7b" member_type: VOTER last_known_addr { host: "127.29.168.253" port: 39851 } } peers { permanent_uuid: "f382f07db19a449cb1645fd6cea776c9" member_type: VOTER last_known_addr { host: "127.29.168.252" port: 37015 } } }
I20260808 14:44:46.670269 31547 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ece2a8bd85471b8019db206619a8f6 [sys.catalog]: This master's current role is: LEADER
W20260808 14:44:46.698525 31294 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.697017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51052 (local address 127.29.168.254:37755)
0808 14:44:46.697056 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.697057 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.697902 (+ 845us) server_negotiation.cc:407] Connection header received
0808 14:44:46.697996 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.697997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.698007 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.698034 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.698454 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51052: BlockingRecv error: recv got EOF from 127.0.0.1:51052 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:44:46.699244 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.697338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40514 (local address 127.29.168.253:39851)
0808 14:44:46.697373 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.697375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.698749 (+ 1374us) server_negotiation.cc:407] Connection header received
0808 14:44:46.698834 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.698835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.698857 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.698885 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.699194 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40514: BlockingRecv error: recv got EOF from 127.0.0.1:40514 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:44:46.699909 31567 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.697643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.29.168.252:37015)
0808 14:44:46.697693 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.697695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.699434 (+ 1739us) server_negotiation.cc:407] Connection header received
0808 14:44:46.699520 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.699521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.699533 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.699559 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.699858 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49748: BlockingRecv error: recv got EOF from 127.0.0.1:49748 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:44:46.701930 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.701265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40516 (local address 127.29.168.253:39851)
0808 14:44:46.701295 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.701296 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.701461 (+ 165us) server_negotiation.cc:407] Connection header received
0808 14:44:46.701552 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.701552 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.701567 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.701592 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.701891 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40516: BlockingRecv error: recv got EOF from 127.0.0.1:40516 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 14:44:46.704692 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.704025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40530 (local address 127.29.168.253:39851)
0808 14:44:46.704053 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.704055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.704256 (+ 201us) server_negotiation.cc:407] Connection header received
0808 14:44:46.704337 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.704338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.704346 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.704372 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.704639 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40530: BlockingRecv error: recv got EOF from 127.0.0.1:40530 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 14:44:46.708468 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.707807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40546 (local address 127.29.168.253:39851)
0808 14:44:46.707836 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.707838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.708058 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:44:46.708140 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.708141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.708148 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.708173 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.708435 (+ 262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40546: BlockingRecv error: recv got EOF from 127.0.0.1:40546 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 14:44:46.714016 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.713400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.29.168.253:39851)
0808 14:44:46.713435 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.713437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.713615 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:44:46.713692 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.713692 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.713700 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.713724 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.713983 (+ 259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40562: BlockingRecv error: recv got EOF from 127.0.0.1:40562 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260808 14:44:46.723739 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.723021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.29.168.253:39851)
0808 14:44:46.723058 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.723059 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.723265 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:44:46.723354 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.723354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.723363 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.723391 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.723700 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40564: BlockingRecv error: recv got EOF from 127.0.0.1:40564 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:44:46.741722 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.740917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40574 (local address 127.29.168.253:39851)
0808 14:44:46.740955 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.740957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.741205 (+ 248us) server_negotiation.cc:407] Connection header received
0808 14:44:46.741315 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.741316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.741326 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.741355 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.741680 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40574: BlockingRecv error: recv got EOF from 127.0.0.1:40574 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:44:46.775990 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.775135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40588 (local address 127.29.168.253:39851)
0808 14:44:46.775193 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.775196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.775310 (+ 114us) server_negotiation.cc:407] Connection header received
0808 14:44:46.775370 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.775371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.775383 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.775472 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.775935 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40588: BlockingRecv error: recv got EOF from 127.0.0.1:40588 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 14:44:46.841703 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.841046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.29.168.253:39851)
0808 14:44:46.841101 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.841103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.841198 (+ 95us) server_negotiation.cc:407] Connection header received
0808 14:44:46.841247 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.841247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.841258 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.841318 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.841645 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40600: BlockingRecv error: recv got EOF from 127.0.0.1:40600 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 14:44:46.971724 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:46.970997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40608 (local address 127.29.168.253:39851)
0808 14:44:46.971075 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:46.971078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:46.971146 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:44:46.971235 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:46.971236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:46.971247 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:46.971289 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:46.971666 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40608: BlockingRecv error: recv got EOF from 127.0.0.1:40608 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 14:44:47.229517 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:44:47.228831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40614 (local address 127.29.168.253:39851)
0808 14:44:47.228900 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:47.228919 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:47.228930 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:44:47.229007 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:47.229008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:47.229024 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:47.229085 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:47.229450 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40614: BlockingRecv error: recv got EOF from 127.0.0.1:40614 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:44:47.582858 31526 catalog_manager.cc:1259] Loaded cluster ID: c7f1b53c82594264bb3265abacf801c3
I20260808 14:44:47.582943 31526 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: loading cluster ID for follower catalog manager: success
I20260808 14:44:47.583740 31526 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: acquiring CA information for follower catalog manager: success
I20260808 14:44:47.584015 31526 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f382f07db19a449cb1645fd6cea776c9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:44:47.668784 31591 catalog_manager.cc:1259] Loaded cluster ID: c7f1b53c82594264bb3265abacf801c3
I20260808 14:44:47.668867 31591 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: loading cluster ID for follower catalog manager: success
I20260808 14:44:47.669776 31591 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: acquiring CA information for follower catalog manager: success
I20260808 14:44:47.670068 31591 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6c844e858b6a41daaa781dbd44fdfb7b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:44:47.745169 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:47.742833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40618 (local address 127.29.168.253:39851)
0808 14:44:47.742937 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:47.742939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:47.742972 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:44:47.743045 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:47.743045 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:47.743096 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:47.743169 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:47.743293 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.743813 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.744456 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.744622 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.744667 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:47.744841 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:47.744953 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:47.745011 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:47.745043 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 14:44:47.745059 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":62,"threads_started":1}
I20260808 14:44:47.749373 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:47.746869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49754 (local address 127.29.168.252:37015)
0808 14:44:47.746991 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:47.746993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:47.747001 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:47.747107 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:47.747108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:47.747158 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:47.747239 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:47.747356 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.747914 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.748615 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.748832 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.748897 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:47.749070 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:47.749159 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:47.749225 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:47.749274 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 14:44:47.749292 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
I20260808 14:44:47.753737 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:47.750925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51054 (local address 127.29.168.254:37755)
0808 14:44:47.751169 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:47.751171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:47.751179 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:47.751219 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:47.751220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:47.751264 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:47.751344 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:47.751457 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.752234 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.752958 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.753212 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.753270 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:47.753427 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:47.753524 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:47.753581 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:47.753624 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 14:44:47.753645 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":44,"threads_started":1}
I20260808 14:44:47.753952 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:47.750990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49764 (local address 127.29.168.252:37015)
0808 14:44:47.751025 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:47.751027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:47.751193 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:44:47.751288 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:47.751290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:47.751299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:47.751352 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:47.751506 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.752192 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.753135 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.753388 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.753446 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:47.753558 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:47.753591 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:47.753634 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:47.753872 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 14:44:47.753891 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:44:47.755278 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:47.751161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40624 (local address 127.29.168.253:39851)
0808 14:44:47.751199 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:47.751201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:47.751350 (+ 149us) server_negotiation.cc:407] Connection header received
0808 14:44:47.751432 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:47.751433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:47.751442 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:47.751492 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:44:47.752413 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.753064 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.754483 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:47.754799 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:47.754862 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:47.755029 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:44:47.755075 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:44:47.755121 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:47.755186 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:44:47.755206 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:47.755435 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31193
I20260808 14:44:47.767324 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31298
I20260808 14:44:47.779577 30371 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskniu_ne/build/release/bin/kudu with pid 31407
2026-08-08T14:44:47Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2934 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5892 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (272152 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST